2026-02-17T11:59:06.209 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T11:59:06.224 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:59:06.300 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51399 branch: wip-bharath20-testing-2026-02-13-0906-squid description: rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51399' kernel: branch: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-bharath20-testing-2026-02-13-0906-squid ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr1: false ms bind msgr2: true ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: mon ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async mgr: debug mgr: 20 debug monc: 10 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos min: 10 paxos service trim min: 5 paxos trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath20-testing-2026-02-13-0906-squid sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 4581 sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath20-testing-2026-02-13-0906-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 targets: trial077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMspI2MrX5oJyHSBUgV+0r2yzjxUohlEfiqJh+O9OzAhVKKpw05DgxPnDmg2gJ9SXG1q726AsQa6ColkLzeCk1g= trial119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEfA1RRhHjOisJ3IYKSNTGUQKBIiulOwR4KPDdWGUThsfhfis232K+D66UoqqITo9F5rpk22HOfDUwwIPShJjIQ= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 thrash_delay: 1 - exec: client.0: - ceph_test_rados_delete_pools_parallel --debug_objecter 20 --debug_ms 1 --debug_rados 20 --debug_monc 20 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:10:36 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T11:59:06.301 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa; will attempt to use it 2026-02-17T11:59:06.301 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks 2026-02-17T11:59:06.301 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T11:59:06.303 INFO:teuthology.task.internal:Checking packages... 2026-02-17T11:59:06.303 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '3c96dfb3f50b3d02598a82af7104764bfdcd3919' 2026-02-17T11:59:06.303 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T11:59:06.303 INFO:teuthology.packaging:ref: None 2026-02-17T11:59:06.303 INFO:teuthology.packaging:tag: None 2026-02-17T11:59:06.303 INFO:teuthology.packaging:branch: wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T11:59:06.303 INFO:teuthology.packaging:sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:59:06.303 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T11:59:06.419 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-675-g3c96dfb3-1jammy 2026-02-17T11:59:06.420 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T11:59:06.431 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T11:59:06.432 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T11:59:06.444 INFO:teuthology.task.internal:Saving configuration 2026-02-17T11:59:06.457 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T11:59:06.470 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T11:59:06.545 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial077.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51399', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:55:36.151581', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKUzule4OqDzt27Rmnwlg24acpGl7dZfOqDZotcX2OA'} 2026-02-17T11:59:06.600 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial119.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51399', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:55:36.150951', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMOPBWNjoPM7pbLE8S8Xgvq1gZXPGn8m5sAivxthAMrp'} 2026-02-17T11:59:06.600 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T11:59:06.612 INFO:teuthology.task.internal:roles: ubuntu@trial077.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2026-02-17T11:59:06.612 INFO:teuthology.task.internal:roles: ubuntu@trial119.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2026-02-17T11:59:06.612 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T11:59:06.743 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x711e06fcaf20>, signals=[15]) 2026-02-17T11:59:06.743 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T11:59:06.755 INFO:teuthology.task.internal:Opening connections... 2026-02-17T11:59:06.755 DEBUG:teuthology.task.internal:connecting to ubuntu@trial077.front.sepia.ceph.com 2026-02-17T11:59:06.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:59:06.820 DEBUG:teuthology.task.internal:connecting to ubuntu@trial119.front.sepia.ceph.com 2026-02-17T11:59:06.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:59:06.885 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T11:59:06.898 DEBUG:teuthology.orchestra.run.trial077:> uname -m 2026-02-17T11:59:06.901 INFO:teuthology.orchestra.run.trial077.stdout:x86_64 2026-02-17T11:59:06.901 DEBUG:teuthology.orchestra.run.trial077:> cat /etc/os-release 2026-02-17T11:59:06.948 INFO:teuthology.orchestra.run.trial077.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-17T11:59:06.948 INFO:teuthology.orchestra.run.trial077.stdout:NAME="Ubuntu" 2026-02-17T11:59:06.948 INFO:teuthology.orchestra.run.trial077.stdout:VERSION_ID="22.04" 2026-02-17T11:59:06.948 INFO:teuthology.orchestra.run.trial077.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-17T11:59:06.948 INFO:teuthology.orchestra.run.trial077.stdout:VERSION_CODENAME=jammy 2026-02-17T11:59:06.948 INFO:teuthology.orchestra.run.trial077.stdout:ID=ubuntu 2026-02-17T11:59:06.948 INFO:teuthology.orchestra.run.trial077.stdout:ID_LIKE=debian 2026-02-17T11:59:06.948 INFO:teuthology.orchestra.run.trial077.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-17T11:59:06.948 INFO:teuthology.orchestra.run.trial077.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-17T11:59:06.948 INFO:teuthology.orchestra.run.trial077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-17T11:59:06.948 INFO:teuthology.orchestra.run.trial077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-17T11:59:06.948 INFO:teuthology.orchestra.run.trial077.stdout:UBUNTU_CODENAME=jammy 2026-02-17T11:59:06.949 INFO:teuthology.lock.ops:Updating trial077.front.sepia.ceph.com on lock server 2026-02-17T11:59:07.019 DEBUG:teuthology.orchestra.run.trial119:> uname -m 2026-02-17T11:59:07.022 INFO:teuthology.orchestra.run.trial119.stdout:x86_64 2026-02-17T11:59:07.022 DEBUG:teuthology.orchestra.run.trial119:> cat /etc/os-release 2026-02-17T11:59:07.066 INFO:teuthology.orchestra.run.trial119.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-17T11:59:07.066 INFO:teuthology.orchestra.run.trial119.stdout:NAME="Ubuntu" 2026-02-17T11:59:07.066 INFO:teuthology.orchestra.run.trial119.stdout:VERSION_ID="22.04" 2026-02-17T11:59:07.066 INFO:teuthology.orchestra.run.trial119.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-17T11:59:07.066 INFO:teuthology.orchestra.run.trial119.stdout:VERSION_CODENAME=jammy 2026-02-17T11:59:07.066 INFO:teuthology.orchestra.run.trial119.stdout:ID=ubuntu 2026-02-17T11:59:07.066 INFO:teuthology.orchestra.run.trial119.stdout:ID_LIKE=debian 2026-02-17T11:59:07.066 INFO:teuthology.orchestra.run.trial119.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-17T11:59:07.066 INFO:teuthology.orchestra.run.trial119.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-17T11:59:07.066 INFO:teuthology.orchestra.run.trial119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-17T11:59:07.066 INFO:teuthology.orchestra.run.trial119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-17T11:59:07.066 INFO:teuthology.orchestra.run.trial119.stdout:UBUNTU_CODENAME=jammy 2026-02-17T11:59:07.066 INFO:teuthology.lock.ops:Updating trial119.front.sepia.ceph.com on lock server 2026-02-17T11:59:07.141 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T11:59:07.155 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T11:59:07.166 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T11:59:07.166 DEBUG:teuthology.orchestra.run.trial077:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:59:07.167 DEBUG:teuthology.orchestra.run.trial119:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:59:07.170 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T11:59:07.184 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T11:59:07.184 DEBUG:teuthology.orchestra.run.trial077:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:59:07.218 DEBUG:teuthology.orchestra.run.trial119:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:59:07.221 INFO:teuthology.orchestra.run.trial077.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-17T11:59:07.222 INFO:teuthology.orchestra.run.trial119.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-17T11:59:07.223 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T11:59:07.376 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T11:59:07.394 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T11:59:07.394 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T11:59:07.394 DEBUG:teuthology.orchestra.run.trial077:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:59:07.395 DEBUG:teuthology.orchestra.run.trial119:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:59:07.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:59:07.397 DEBUG:teuthology.orchestra.run.trial077:> uname -r 2026-02-17T11:59:07.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:59:07.398 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-17T11:59:07.442 INFO:teuthology.orchestra.run.trial119.stdout:5.15.0-164-generic 2026-02-17T11:59:07.442 INFO:teuthology.task.kernel:Running kernel on trial119: 5.15.0-164-generic 2026-02-17T11:59:07.442 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-get clean 2026-02-17T11:59:07.444 INFO:teuthology.orchestra.run.trial077.stdout:5.15.0-164-generic 2026-02-17T11:59:07.444 INFO:teuthology.task.kernel:Running kernel on trial077: 5.15.0-164-generic 2026-02-17T11:59:07.444 DEBUG:teuthology.orchestra.run.trial077:> sudo apt-get clean 2026-02-17T11:59:07.500 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-get update 2026-02-17T11:59:07.501 DEBUG:teuthology.orchestra.run.trial077:> sudo apt-get update 2026-02-17T11:59:07.684 INFO:teuthology.orchestra.run.trial077.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T11:59:07.692 INFO:teuthology.orchestra.run.trial077.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-17T11:59:07.730 INFO:teuthology.orchestra.run.trial077.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-17T11:59:07.745 INFO:teuthology.orchestra.run.trial077.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-17T11:59:07.819 INFO:teuthology.orchestra.run.trial077.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3236 kB] 2026-02-17T11:59:07.888 INFO:teuthology.orchestra.run.trial077.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [493 kB] 2026-02-17T11:59:07.891 INFO:teuthology.orchestra.run.trial077.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-17T11:59:07.892 INFO:teuthology.orchestra.run.trial077.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1255 kB] 2026-02-17T11:59:07.899 INFO:teuthology.orchestra.run.trial077.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-17T11:59:07.901 INFO:teuthology.orchestra.run.trial077.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-17T11:59:07.901 INFO:teuthology.orchestra.run.trial077.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5287 kB] 2026-02-17T11:59:07.931 INFO:teuthology.orchestra.run.trial119.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T11:59:07.931 INFO:teuthology.orchestra.run.trial077.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [997 kB] 2026-02-17T11:59:07.933 INFO:teuthology.orchestra.run.trial077.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2966 kB] 2026-02-17T11:59:07.945 INFO:teuthology.orchestra.run.trial077.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [426 kB] 2026-02-17T11:59:07.946 INFO:teuthology.orchestra.run.trial077.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-17T11:59:07.947 INFO:teuthology.orchestra.run.trial077.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-17T11:59:07.949 INFO:teuthology.orchestra.run.trial077.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-17T11:59:07.950 INFO:teuthology.orchestra.run.trial077.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-17T11:59:07.950 INFO:teuthology.orchestra.run.trial077.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5096 kB] 2026-02-17T11:59:07.971 INFO:teuthology.orchestra.run.trial077.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [964 kB] 2026-02-17T11:59:08.006 INFO:teuthology.orchestra.run.trial119.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-17T11:59:08.279 INFO:teuthology.orchestra.run.trial119.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-17T11:59:08.401 INFO:teuthology.orchestra.run.trial119.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-17T11:59:08.516 INFO:teuthology.orchestra.run.trial119.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3236 kB] 2026-02-17T11:59:08.845 INFO:teuthology.orchestra.run.trial119.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [493 kB] 2026-02-17T11:59:08.855 INFO:teuthology.orchestra.run.trial119.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-17T11:59:08.855 INFO:teuthology.orchestra.run.trial119.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1255 kB] 2026-02-17T11:59:08.884 INFO:teuthology.orchestra.run.trial119.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-17T11:59:08.890 INFO:teuthology.orchestra.run.trial119.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-17T11:59:08.890 INFO:teuthology.orchestra.run.trial119.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5287 kB] 2026-02-17T11:59:09.019 INFO:teuthology.orchestra.run.trial119.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [997 kB] 2026-02-17T11:59:09.037 INFO:teuthology.orchestra.run.trial119.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2966 kB] 2026-02-17T11:59:09.108 INFO:teuthology.orchestra.run.trial119.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [426 kB] 2026-02-17T11:59:09.116 INFO:teuthology.orchestra.run.trial119.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-17T11:59:09.116 INFO:teuthology.orchestra.run.trial119.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-17T11:59:09.144 INFO:teuthology.orchestra.run.trial119.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-17T11:59:09.151 INFO:teuthology.orchestra.run.trial119.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-17T11:59:09.152 INFO:teuthology.orchestra.run.trial119.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5096 kB] 2026-02-17T11:59:09.270 INFO:teuthology.orchestra.run.trial119.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [964 kB] 2026-02-17T11:59:11.641 INFO:teuthology.orchestra.run.trial077.stdout:Fetched 22.7 MB in 2s (13.7 MB/s) 2026-02-17T11:59:12.164 INFO:teuthology.orchestra.run.trial077.stdout:Reading package lists... 2026-02-17T11:59:12.177 DEBUG:teuthology.orchestra.run.trial077:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T11:59:12.210 INFO:teuthology.orchestra.run.trial077.stdout:Reading package lists... 2026-02-17T11:59:12.316 INFO:teuthology.orchestra.run.trial077.stdout:Building dependency tree... 2026-02-17T11:59:12.316 INFO:teuthology.orchestra.run.trial077.stdout:Reading state information... 2026-02-17T11:59:12.402 INFO:teuthology.orchestra.run.trial077.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T11:59:12.402 INFO:teuthology.orchestra.run.trial077.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T11:59:12.402 INFO:teuthology.orchestra.run.trial077.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T11:59:12.402 INFO:teuthology.orchestra.run.trial077.stdout: sg3-utils-udev 2026-02-17T11:59:12.402 INFO:teuthology.orchestra.run.trial077.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T11:59:12.402 INFO:teuthology.orchestra.run.trial077.stdout:The following additional packages will be installed: 2026-02-17T11:59:12.402 INFO:teuthology.orchestra.run.trial077.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T11:59:12.402 INFO:teuthology.orchestra.run.trial077.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-17T11:59:12.402 INFO:teuthology.orchestra.run.trial077.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-17T11:59:12.403 INFO:teuthology.orchestra.run.trial077.stdout:Suggested packages: 2026-02-17T11:59:12.403 INFO:teuthology.orchestra.run.trial077.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-17T11:59:12.415 INFO:teuthology.orchestra.run.trial077.stdout:The following NEW packages will be installed: 2026-02-17T11:59:12.416 INFO:teuthology.orchestra.run.trial077.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T11:59:12.416 INFO:teuthology.orchestra.run.trial077.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-17T11:59:12.416 INFO:teuthology.orchestra.run.trial077.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-17T11:59:12.416 INFO:teuthology.orchestra.run.trial077.stdout:The following packages will be upgraded: 2026-02-17T11:59:12.416 INFO:teuthology.orchestra.run.trial077.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-17T11:59:12.590 INFO:teuthology.orchestra.run.trial119.stdout:Fetched 22.7 MB in 3s (8650 kB/s) 2026-02-17T11:59:12.825 INFO:teuthology.orchestra.run.trial077.stdout:3 upgraded, 5 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T11:59:12.826 INFO:teuthology.orchestra.run.trial077.stdout:Need to get 113 MB of archives. 2026-02-17T11:59:12.826 INFO:teuthology.orchestra.run.trial077.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-17T11:59:12.826 INFO:teuthology.orchestra.run.trial077.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-17T11:59:13.108 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-17T11:59:13.122 DEBUG:teuthology.orchestra.run.trial119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T11:59:13.154 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-17T11:59:13.257 INFO:teuthology.orchestra.run.trial119.stdout:Building dependency tree... 2026-02-17T11:59:13.258 INFO:teuthology.orchestra.run.trial119.stdout:Reading state information... 2026-02-17T11:59:13.342 INFO:teuthology.orchestra.run.trial119.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T11:59:13.342 INFO:teuthology.orchestra.run.trial119.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T11:59:13.342 INFO:teuthology.orchestra.run.trial119.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T11:59:13.342 INFO:teuthology.orchestra.run.trial119.stdout: sg3-utils-udev 2026-02-17T11:59:13.343 INFO:teuthology.orchestra.run.trial119.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T11:59:13.343 INFO:teuthology.orchestra.run.trial119.stdout:The following additional packages will be installed: 2026-02-17T11:59:13.343 INFO:teuthology.orchestra.run.trial119.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T11:59:13.343 INFO:teuthology.orchestra.run.trial119.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-17T11:59:13.343 INFO:teuthology.orchestra.run.trial119.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-17T11:59:13.343 INFO:teuthology.orchestra.run.trial119.stdout:Suggested packages: 2026-02-17T11:59:13.343 INFO:teuthology.orchestra.run.trial119.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-17T11:59:13.354 INFO:teuthology.orchestra.run.trial119.stdout:The following NEW packages will be installed: 2026-02-17T11:59:13.354 INFO:teuthology.orchestra.run.trial119.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T11:59:13.355 INFO:teuthology.orchestra.run.trial119.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-17T11:59:13.355 INFO:teuthology.orchestra.run.trial119.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-17T11:59:13.355 INFO:teuthology.orchestra.run.trial119.stdout:The following packages will be upgraded: 2026-02-17T11:59:13.355 INFO:teuthology.orchestra.run.trial119.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-17T11:59:13.776 INFO:teuthology.orchestra.run.trial119.stdout:3 upgraded, 5 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T11:59:13.776 INFO:teuthology.orchestra.run.trial119.stdout:Need to get 113 MB of archives. 2026-02-17T11:59:13.776 INFO:teuthology.orchestra.run.trial119.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-17T11:59:13.776 INFO:teuthology.orchestra.run.trial119.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-17T11:59:14.164 INFO:teuthology.orchestra.run.trial077.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-17T11:59:14.493 INFO:teuthology.orchestra.run.trial077.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-17T11:59:15.158 INFO:teuthology.orchestra.run.trial119.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-17T11:59:15.499 INFO:teuthology.orchestra.run.trial119.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-17T11:59:16.331 INFO:teuthology.orchestra.run.trial077.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-17T11:59:16.331 INFO:teuthology.orchestra.run.trial077.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-17T11:59:16.331 INFO:teuthology.orchestra.run.trial077.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-17T11:59:16.674 INFO:teuthology.orchestra.run.trial077.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-17T11:59:16.754 INFO:teuthology.orchestra.run.trial077.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-17T11:59:16.949 INFO:teuthology.orchestra.run.trial077.stdout:Fetched 113 MB in 4s (26.2 MB/s) 2026-02-17T11:59:16.965 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-17T11:59:17.126 INFO:teuthology.orchestra.run.trial077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-17T11:59:17.128 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:59:17.129 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:17.401 INFO:teuthology.orchestra.run.trial119.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-17T11:59:17.402 INFO:teuthology.orchestra.run.trial119.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-17T11:59:17.402 INFO:teuthology.orchestra.run.trial119.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-17T11:59:17.482 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-17T11:59:17.489 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:59:17.511 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:17.551 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-17T11:59:17.557 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:59:17.558 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:17.755 INFO:teuthology.orchestra.run.trial119.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-17T11:59:17.838 INFO:teuthology.orchestra.run.trial119.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-17T11:59:18.033 INFO:teuthology.orchestra.run.trial119.stdout:Fetched 113 MB in 4s (25.3 MB/s) 2026-02-17T11:59:18.054 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-17T11:59:18.217 INFO:teuthology.orchestra.run.trial119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-17T11:59:18.219 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:59:18.220 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:18.569 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-17T11:59:18.576 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:59:18.596 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:18.635 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-17T11:59:18.642 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:59:18.642 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:18.669 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T11:59:18.671 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T11:59:18.692 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T11:59:18.693 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T11:59:18.711 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-17T11:59:18.718 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-17T11:59:18.719 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T11:59:19.747 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T11:59:19.748 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T11:59:19.769 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T11:59:19.770 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T11:59:19.786 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-17T11:59:19.793 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-17T11:59:19.794 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T11:59:20.083 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-17T11:59:20.095 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:59:20.095 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:20.679 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T11:59:20.679 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T11:59:20.705 INFO:teuthology.orchestra.run.trial077.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T11:59:20.707 INFO:teuthology.orchestra.run.trial077.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:20.709 INFO:teuthology.orchestra.run.trial077.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-17T11:59:20.710 INFO:teuthology.orchestra.run.trial077.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:21.176 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-17T11:59:21.188 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:59:21.189 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:21.476 INFO:teuthology.orchestra.run.trial077.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:21.770 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T11:59:21.770 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T11:59:21.796 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T11:59:21.797 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:21.799 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-17T11:59:21.800 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:22.298 INFO:teuthology.orchestra.run.trial077.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-17T11:59:22.298 INFO:teuthology.orchestra.run.trial077.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-17T11:59:22.303 INFO:teuthology.orchestra.run.trial077.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:22.570 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:23.095 INFO:teuthology.orchestra.run.trial077.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-17T11:59:23.097 INFO:teuthology.orchestra.run.trial077.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-17T11:59:23.098 INFO:teuthology.orchestra.run.trial077.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:23.103 INFO:teuthology.orchestra.run.trial077.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-17T11:59:23.103 INFO:teuthology.orchestra.run.trial077.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-17T11:59:23.396 INFO:teuthology.orchestra.run.trial119.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-17T11:59:23.396 INFO:teuthology.orchestra.run.trial119.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-17T11:59:23.401 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:24.194 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-17T11:59:24.195 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-17T11:59:24.196 INFO:teuthology.orchestra.run.trial119.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:59:24.201 INFO:teuthology.orchestra.run.trial119.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-17T11:59:24.201 INFO:teuthology.orchestra.run.trial119.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-17T11:59:30.145 INFO:teuthology.orchestra.run.trial077.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-17T11:59:31.228 INFO:teuthology.orchestra.run.trial119.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-17T11:59:36.732 INFO:teuthology.orchestra.run.trial077.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-17T11:59:36.732 INFO:teuthology.orchestra.run.trial077.stdout:Sourcing file `/etc/default/grub' 2026-02-17T11:59:36.751 INFO:teuthology.orchestra.run.trial077.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T11:59:36.752 INFO:teuthology.orchestra.run.trial077.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T11:59:36.754 INFO:teuthology.orchestra.run.trial077.stdout:Generating grub configuration file ... 2026-02-17T11:59:36.834 INFO:teuthology.orchestra.run.trial077.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T11:59:36.841 INFO:teuthology.orchestra.run.trial077.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T11:59:37.013 INFO:teuthology.orchestra.run.trial077.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T11:59:37.019 INFO:teuthology.orchestra.run.trial077.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T11:59:37.089 INFO:teuthology.orchestra.run.trial077.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T11:59:37.089 INFO:teuthology.orchestra.run.trial077.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T11:59:37.089 INFO:teuthology.orchestra.run.trial077.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T11:59:37.092 INFO:teuthology.orchestra.run.trial077.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:59:37.101 INFO:teuthology.orchestra.run.trial077.stdout:done 2026-02-17T11:59:37.503 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:59:37.503 INFO:teuthology.orchestra.run.trial077.stdout:Pending kernel upgrade! 2026-02-17T11:59:37.504 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:59:37.504 INFO:teuthology.orchestra.run.trial077.stdout:Running kernel version: 2026-02-17T11:59:37.504 INFO:teuthology.orchestra.run.trial077.stdout: 5.15.0-164-generic 2026-02-17T11:59:37.504 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:59:37.504 INFO:teuthology.orchestra.run.trial077.stdout:Diagnostics: 2026-02-17T11:59:37.504 INFO:teuthology.orchestra.run.trial077.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-17T11:59:37.504 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:59:37.504 INFO:teuthology.orchestra.run.trial077.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-17T11:59:37.504 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:59:37.504 INFO:teuthology.orchestra.run.trial077.stdout:The processor microcode seems to be up-to-date. 2026-02-17T11:59:37.505 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:59:37.505 INFO:teuthology.orchestra.run.trial077.stdout:No services need to be restarted. 2026-02-17T11:59:37.505 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:59:37.505 INFO:teuthology.orchestra.run.trial077.stdout:No containers need to be restarted. 2026-02-17T11:59:37.505 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:59:37.505 INFO:teuthology.orchestra.run.trial077.stdout:No user sessions are running outdated binaries. 2026-02-17T11:59:37.505 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:59:37.505 INFO:teuthology.orchestra.run.trial077.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T11:59:37.866 INFO:teuthology.orchestra.run.trial119.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-17T11:59:37.867 INFO:teuthology.orchestra.run.trial119.stdout:Sourcing file `/etc/default/grub' 2026-02-17T11:59:37.885 INFO:teuthology.orchestra.run.trial119.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T11:59:37.886 INFO:teuthology.orchestra.run.trial119.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T11:59:37.888 INFO:teuthology.orchestra.run.trial119.stdout:Generating grub configuration file ... 2026-02-17T11:59:37.969 INFO:teuthology.orchestra.run.trial119.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T11:59:37.975 INFO:teuthology.orchestra.run.trial119.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T11:59:38.144 INFO:teuthology.orchestra.run.trial119.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T11:59:38.150 INFO:teuthology.orchestra.run.trial119.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T11:59:38.169 DEBUG:teuthology.orchestra.run.trial077:> dpkg -s linux-image-generic 2026-02-17T11:59:38.180 INFO:teuthology.orchestra.run.trial077.stdout:Package: linux-image-generic 2026-02-17T11:59:38.180 INFO:teuthology.orchestra.run.trial077.stdout:Status: install ok installed 2026-02-17T11:59:38.180 INFO:teuthology.orchestra.run.trial077.stdout:Priority: optional 2026-02-17T11:59:38.180 INFO:teuthology.orchestra.run.trial077.stdout:Section: kernel 2026-02-17T11:59:38.181 INFO:teuthology.orchestra.run.trial077.stdout:Installed-Size: 21 2026-02-17T11:59:38.181 INFO:teuthology.orchestra.run.trial077.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T11:59:38.181 INFO:teuthology.orchestra.run.trial077.stdout:Architecture: amd64 2026-02-17T11:59:38.181 INFO:teuthology.orchestra.run.trial077.stdout:Source: linux-meta 2026-02-17T11:59:38.181 INFO:teuthology.orchestra.run.trial077.stdout:Version: 5.15.0.170.159 2026-02-17T11:59:38.181 INFO:teuthology.orchestra.run.trial077.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T11:59:38.181 INFO:teuthology.orchestra.run.trial077.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T11:59:38.181 INFO:teuthology.orchestra.run.trial077.stdout:Recommends: thermald 2026-02-17T11:59:38.181 INFO:teuthology.orchestra.run.trial077.stdout:Description: Generic Linux kernel image 2026-02-17T11:59:38.181 INFO:teuthology.orchestra.run.trial077.stdout: This package will always depend on the latest generic kernel image 2026-02-17T11:59:38.182 INFO:teuthology.orchestra.run.trial077.stdout: available. 2026-02-17T11:59:38.182 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-17T11:59:38.182 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:59:38.182 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:59:38.182 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T11:59:38.182 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial077.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:59:38.183 DEBUG:teuthology.orchestra.run.trial077:> sudo apt-get clean 2026-02-17T11:59:38.220 INFO:teuthology.orchestra.run.trial119.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T11:59:38.221 INFO:teuthology.orchestra.run.trial119.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T11:59:38.221 INFO:teuthology.orchestra.run.trial119.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T11:59:38.223 INFO:teuthology.orchestra.run.trial119.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:59:38.232 INFO:teuthology.orchestra.run.trial119.stdout:done 2026-02-17T11:59:38.262 DEBUG:teuthology.orchestra.run.trial077:> sudo apt-get update 2026-02-17T11:59:38.620 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T11:59:38.620 INFO:teuthology.orchestra.run.trial119.stdout:Pending kernel upgrade! 2026-02-17T11:59:38.620 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T11:59:38.620 INFO:teuthology.orchestra.run.trial119.stdout:Running kernel version: 2026-02-17T11:59:38.620 INFO:teuthology.orchestra.run.trial119.stdout: 5.15.0-164-generic 2026-02-17T11:59:38.620 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T11:59:38.620 INFO:teuthology.orchestra.run.trial119.stdout:Diagnostics: 2026-02-17T11:59:38.620 INFO:teuthology.orchestra.run.trial119.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-17T11:59:38.620 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T11:59:38.621 INFO:teuthology.orchestra.run.trial119.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-17T11:59:38.621 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T11:59:38.621 INFO:teuthology.orchestra.run.trial119.stdout:The processor microcode seems to be up-to-date. 2026-02-17T11:59:38.621 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T11:59:38.621 INFO:teuthology.orchestra.run.trial119.stdout:No services need to be restarted. 2026-02-17T11:59:38.621 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T11:59:38.621 INFO:teuthology.orchestra.run.trial119.stdout:No containers need to be restarted. 2026-02-17T11:59:38.621 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T11:59:38.621 INFO:teuthology.orchestra.run.trial119.stdout:No user sessions are running outdated binaries. 2026-02-17T11:59:38.621 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T11:59:38.621 INFO:teuthology.orchestra.run.trial119.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T11:59:38.758 INFO:teuthology.orchestra.run.trial077.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T11:59:38.841 INFO:teuthology.orchestra.run.trial077.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T11:59:39.266 DEBUG:teuthology.orchestra.run.trial119:> dpkg -s linux-image-generic 2026-02-17T11:59:39.268 INFO:teuthology.orchestra.run.trial077.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T11:59:39.277 INFO:teuthology.orchestra.run.trial119.stdout:Package: linux-image-generic 2026-02-17T11:59:39.277 INFO:teuthology.orchestra.run.trial119.stdout:Status: install ok installed 2026-02-17T11:59:39.277 INFO:teuthology.orchestra.run.trial119.stdout:Priority: optional 2026-02-17T11:59:39.277 INFO:teuthology.orchestra.run.trial119.stdout:Section: kernel 2026-02-17T11:59:39.278 INFO:teuthology.orchestra.run.trial119.stdout:Installed-Size: 21 2026-02-17T11:59:39.278 INFO:teuthology.orchestra.run.trial119.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T11:59:39.278 INFO:teuthology.orchestra.run.trial119.stdout:Architecture: amd64 2026-02-17T11:59:39.278 INFO:teuthology.orchestra.run.trial119.stdout:Source: linux-meta 2026-02-17T11:59:39.278 INFO:teuthology.orchestra.run.trial119.stdout:Version: 5.15.0.170.159 2026-02-17T11:59:39.278 INFO:teuthology.orchestra.run.trial119.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T11:59:39.278 INFO:teuthology.orchestra.run.trial119.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T11:59:39.278 INFO:teuthology.orchestra.run.trial119.stdout:Recommends: thermald 2026-02-17T11:59:39.278 INFO:teuthology.orchestra.run.trial119.stdout:Description: Generic Linux kernel image 2026-02-17T11:59:39.278 INFO:teuthology.orchestra.run.trial119.stdout: This package will always depend on the latest generic kernel image 2026-02-17T11:59:39.279 INFO:teuthology.orchestra.run.trial119.stdout: available. 2026-02-17T11:59:39.279 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-17T11:59:39.279 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:59:39.279 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:59:39.279 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-17T11:59:39.279 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial119.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:59:39.280 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-get clean 2026-02-17T11:59:39.359 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-get update 2026-02-17T11:59:39.360 INFO:teuthology.orchestra.run.trial077.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T11:59:39.852 INFO:teuthology.orchestra.run.trial119.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T11:59:39.936 INFO:teuthology.orchestra.run.trial119.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T11:59:40.012 INFO:teuthology.orchestra.run.trial077.stdout:Reading package lists... 2026-02-17T11:59:40.024 INFO:teuthology.orchestra.run.trial119.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T11:59:40.026 DEBUG:teuthology.orchestra.run.trial077:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T11:59:40.103 INFO:teuthology.orchestra.run.trial077.stdout:Reading package lists... 2026-02-17T11:59:40.112 INFO:teuthology.orchestra.run.trial119.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T11:59:40.214 INFO:teuthology.orchestra.run.trial077.stdout:Building dependency tree... 2026-02-17T11:59:40.215 INFO:teuthology.orchestra.run.trial077.stdout:Reading state information... 2026-02-17T11:59:40.301 INFO:teuthology.orchestra.run.trial077.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-17T11:59:40.301 INFO:teuthology.orchestra.run.trial077.stdout:linux-image-generic set to manually installed. 2026-02-17T11:59:40.301 INFO:teuthology.orchestra.run.trial077.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T11:59:40.302 INFO:teuthology.orchestra.run.trial077.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T11:59:40.302 INFO:teuthology.orchestra.run.trial077.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T11:59:40.302 INFO:teuthology.orchestra.run.trial077.stdout: sg3-utils-udev 2026-02-17T11:59:40.302 INFO:teuthology.orchestra.run.trial077.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T11:59:40.321 INFO:teuthology.orchestra.run.trial077.stdout:0 upgraded, 0 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T11:59:40.323 DEBUG:teuthology.orchestra.run.trial077:> dpkg -s linux-image-generic 2026-02-17T11:59:40.375 INFO:teuthology.orchestra.run.trial077.stdout:Package: linux-image-generic 2026-02-17T11:59:40.375 INFO:teuthology.orchestra.run.trial077.stdout:Status: install ok installed 2026-02-17T11:59:40.375 INFO:teuthology.orchestra.run.trial077.stdout:Priority: optional 2026-02-17T11:59:40.375 INFO:teuthology.orchestra.run.trial077.stdout:Section: kernel 2026-02-17T11:59:40.376 INFO:teuthology.orchestra.run.trial077.stdout:Installed-Size: 21 2026-02-17T11:59:40.376 INFO:teuthology.orchestra.run.trial077.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T11:59:40.376 INFO:teuthology.orchestra.run.trial077.stdout:Architecture: amd64 2026-02-17T11:59:40.376 INFO:teuthology.orchestra.run.trial077.stdout:Source: linux-meta 2026-02-17T11:59:40.376 INFO:teuthology.orchestra.run.trial077.stdout:Version: 5.15.0.170.159 2026-02-17T11:59:40.376 INFO:teuthology.orchestra.run.trial077.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T11:59:40.376 INFO:teuthology.orchestra.run.trial077.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T11:59:40.376 INFO:teuthology.orchestra.run.trial077.stdout:Recommends: thermald 2026-02-17T11:59:40.376 INFO:teuthology.orchestra.run.trial077.stdout:Description: Generic Linux kernel image 2026-02-17T11:59:40.376 INFO:teuthology.orchestra.run.trial077.stdout: This package will always depend on the latest generic kernel image 2026-02-17T11:59:40.376 INFO:teuthology.orchestra.run.trial077.stdout: available. 2026-02-17T11:59:40.377 DEBUG:teuthology.orchestra.run.trial077:> mktemp 2026-02-17T11:59:40.422 INFO:teuthology.orchestra.run.trial077.stdout:/tmp/tmp.Yg6pa06KlT 2026-02-17T11:59:40.422 DEBUG:teuthology.orchestra.run.trial077:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Yg6pa06KlT 2026-02-17T11:59:40.474 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod 0666 /tmp/tmp.Yg6pa06KlT 2026-02-17T11:59:40.572 DEBUG:teuthology.orchestra.remote:trial077:/tmp/tmp.Yg6pa06KlT is 7KB 2026-02-17T11:59:40.622 DEBUG:teuthology.orchestra.run.trial077:> rm -fr /tmp/tmp.Yg6pa06KlT 2026-02-17T11:59:40.627 DEBUG:teuthology.orchestra.run.trial077:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-17T11:59:40.678 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:59:40.678 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-17T11:59:40.678 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-17T11:59:40.732 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-17T11:59:40.732 DEBUG:teuthology.orchestra.run.trial077:> sudo update-grub 2026-02-17T11:59:40.755 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-17T11:59:40.768 DEBUG:teuthology.orchestra.run.trial119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T11:59:40.802 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-17T11:59:40.914 INFO:teuthology.orchestra.run.trial119.stdout:Building dependency tree... 2026-02-17T11:59:40.915 INFO:teuthology.orchestra.run.trial119.stdout:Reading state information... 2026-02-17T11:59:40.967 INFO:teuthology.orchestra.run.trial077.stderr:Sourcing file `/etc/default/grub' 2026-02-17T11:59:40.986 INFO:teuthology.orchestra.run.trial077.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T11:59:40.986 INFO:teuthology.orchestra.run.trial077.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T11:59:40.988 INFO:teuthology.orchestra.run.trial077.stderr:Generating grub configuration file ... 2026-02-17T11:59:41.000 INFO:teuthology.orchestra.run.trial119.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-17T11:59:41.000 INFO:teuthology.orchestra.run.trial119.stdout:linux-image-generic set to manually installed. 2026-02-17T11:59:41.000 INFO:teuthology.orchestra.run.trial119.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T11:59:41.000 INFO:teuthology.orchestra.run.trial119.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T11:59:41.000 INFO:teuthology.orchestra.run.trial119.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T11:59:41.000 INFO:teuthology.orchestra.run.trial119.stdout: sg3-utils-udev 2026-02-17T11:59:41.000 INFO:teuthology.orchestra.run.trial119.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T11:59:41.020 INFO:teuthology.orchestra.run.trial119.stdout:0 upgraded, 0 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T11:59:41.022 DEBUG:teuthology.orchestra.run.trial119:> dpkg -s linux-image-generic 2026-02-17T11:59:41.066 INFO:teuthology.orchestra.run.trial077.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T11:59:41.072 INFO:teuthology.orchestra.run.trial077.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T11:59:41.074 INFO:teuthology.orchestra.run.trial119.stdout:Package: linux-image-generic 2026-02-17T11:59:41.074 INFO:teuthology.orchestra.run.trial119.stdout:Status: install ok installed 2026-02-17T11:59:41.074 INFO:teuthology.orchestra.run.trial119.stdout:Priority: optional 2026-02-17T11:59:41.074 INFO:teuthology.orchestra.run.trial119.stdout:Section: kernel 2026-02-17T11:59:41.074 INFO:teuthology.orchestra.run.trial119.stdout:Installed-Size: 21 2026-02-17T11:59:41.074 INFO:teuthology.orchestra.run.trial119.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T11:59:41.074 INFO:teuthology.orchestra.run.trial119.stdout:Architecture: amd64 2026-02-17T11:59:41.075 INFO:teuthology.orchestra.run.trial119.stdout:Source: linux-meta 2026-02-17T11:59:41.075 INFO:teuthology.orchestra.run.trial119.stdout:Version: 5.15.0.170.159 2026-02-17T11:59:41.075 INFO:teuthology.orchestra.run.trial119.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T11:59:41.075 INFO:teuthology.orchestra.run.trial119.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T11:59:41.075 INFO:teuthology.orchestra.run.trial119.stdout:Recommends: thermald 2026-02-17T11:59:41.075 INFO:teuthology.orchestra.run.trial119.stdout:Description: Generic Linux kernel image 2026-02-17T11:59:41.075 INFO:teuthology.orchestra.run.trial119.stdout: This package will always depend on the latest generic kernel image 2026-02-17T11:59:41.075 INFO:teuthology.orchestra.run.trial119.stdout: available. 2026-02-17T11:59:41.076 DEBUG:teuthology.orchestra.run.trial119:> mktemp 2026-02-17T11:59:41.120 INFO:teuthology.orchestra.run.trial119.stdout:/tmp/tmp.uiaqcWVSl8 2026-02-17T11:59:41.120 DEBUG:teuthology.orchestra.run.trial119:> sudo cp /boot/grub/grub.cfg /tmp/tmp.uiaqcWVSl8 2026-02-17T11:59:41.172 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 0666 /tmp/tmp.uiaqcWVSl8 2026-02-17T11:59:41.241 INFO:teuthology.orchestra.run.trial077.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T11:59:41.247 INFO:teuthology.orchestra.run.trial077.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T11:59:41.274 DEBUG:teuthology.orchestra.remote:trial119:/tmp/tmp.uiaqcWVSl8 is 7KB 2026-02-17T11:59:41.282 DEBUG:teuthology.orchestra.run.trial119:> rm -fr /tmp/tmp.uiaqcWVSl8 2026-02-17T11:59:41.286 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-17T11:59:41.318 INFO:teuthology.orchestra.run.trial077.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T11:59:41.318 INFO:teuthology.orchestra.run.trial077.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T11:59:41.318 INFO:teuthology.orchestra.run.trial077.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T11:59:41.320 INFO:teuthology.orchestra.run.trial077.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:59:41.328 INFO:teuthology.orchestra.run.trial077.stderr:done 2026-02-17T11:59:41.329 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial077 2026-02-17T11:59:41.330 DEBUG:teuthology.orchestra.run.trial077:> sudo bash -c ' 2026-02-17T11:59:41.330 DEBUG:teuthology.orchestra.run.trial077:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:59:41.330 DEBUG:teuthology.orchestra.run.trial077:> ' 2026-02-17T11:59:41.335 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T11:59:41.336 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-17T11:59:41.336 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-17T11:59:41.389 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-17T11:59:41.390 DEBUG:teuthology.orchestra.run.trial119:> sudo update-grub 2026-02-17T11:59:41.624 INFO:teuthology.orchestra.run.trial119.stderr:Sourcing file `/etc/default/grub' 2026-02-17T11:59:41.643 INFO:teuthology.orchestra.run.trial119.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T11:59:41.644 INFO:teuthology.orchestra.run.trial119.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T11:59:41.646 INFO:teuthology.orchestra.run.trial119.stderr:Generating grub configuration file ... 2026-02-17T11:59:41.723 INFO:teuthology.orchestra.run.trial119.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T11:59:41.729 INFO:teuthology.orchestra.run.trial119.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T11:59:41.898 INFO:teuthology.orchestra.run.trial119.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T11:59:41.903 INFO:teuthology.orchestra.run.trial119.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T11:59:41.974 INFO:teuthology.orchestra.run.trial119.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T11:59:41.974 INFO:teuthology.orchestra.run.trial119.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T11:59:41.974 INFO:teuthology.orchestra.run.trial119.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T11:59:41.976 INFO:teuthology.orchestra.run.trial119.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:59:41.984 INFO:teuthology.orchestra.run.trial119.stderr:done 2026-02-17T11:59:41.985 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial119 2026-02-17T11:59:41.986 DEBUG:teuthology.orchestra.run.trial119:> sudo bash -c ' 2026-02-17T11:59:41.986 DEBUG:teuthology.orchestra.run.trial119:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:59:41.986 DEBUG:teuthology.orchestra.run.trial119:> ' 2026-02-17T12:00:11.333 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T12:00:11.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial077.front.sepia.ceph.com' 2026-02-17T12:00:11.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:00:11.989 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-17T12:00:11.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-17T12:00:11.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:01:11.394 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T12:01:11.993 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T12:01:20.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial077.front.sepia.ceph.com' 2026-02-17T12:01:20.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:01:20.531 DEBUG:teuthology.orchestra.run.trial077:> true 2026-02-17T12:01:20.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial077.front.sepia.ceph.com' 2026-02-17T12:01:20.921 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-17T12:01:20.921 DEBUG:teuthology.orchestra.run.trial077:> uname -r 2026-02-17T12:01:20.966 INFO:teuthology.orchestra.run.trial077.stdout:5.15.0-170-generic 2026-02-17T12:01:20.966 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-17T12:01:20.966 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T12:01:20.966 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-17T12:01:20.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-17T12:01:20.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:01:21.088 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-17T12:01:21.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-17T12:01:21.495 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-170-generic"... 2026-02-17T12:01:21.495 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-17T12:01:21.542 INFO:teuthology.orchestra.run.trial119.stdout:5.15.0-170-generic 2026-02-17T12:01:21.542 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-17T12:01:21.542 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T12:01:21.542 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-17T12:01:21.966 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T12:01:21.967 DEBUG:teuthology.orchestra.run.trial077:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T12:01:21.979 INFO:teuthology.orchestra.run.trial077.stdout:ttyS1 2026-02-17T12:01:22.009 DEBUG:teuthology.parallel:result is None 2026-02-17T12:01:22.543 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-17T12:01:22.544 DEBUG:teuthology.orchestra.run.trial119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T12:01:22.557 INFO:teuthology.orchestra.run.trial119.stdout:ttyS1 2026-02-17T12:01:22.576 DEBUG:teuthology.parallel:result is None 2026-02-17T12:01:22.576 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T12:01:22.587 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T12:01:22.587 DEBUG:teuthology.orchestra.run.trial077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T12:01:22.589 DEBUG:teuthology.orchestra.run.trial119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T12:01:22.622 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T12:01:22.636 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T12:01:22.647 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T12:01:22.647 DEBUG:teuthology.orchestra.run.trial077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T12:01:22.648 DEBUG:teuthology.orchestra.run.trial119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T12:01:22.671 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T12:01:22.685 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T12:01:22.685 DEBUG:teuthology.orchestra.run.trial077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T12:01:22.696 DEBUG:teuthology.orchestra.run.trial119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T12:01:22.704 INFO:teuthology.orchestra.run.trial077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:01:22.710 INFO:teuthology.orchestra.run.trial077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:01:22.714 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:01:22.721 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:01:22.722 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T12:01:22.735 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T12:01:22.736 DEBUG:teuthology.orchestra.run.trial077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T12:01:22.756 DEBUG:teuthology.orchestra.run.trial119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T12:01:22.774 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T12:01:22.835 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T12:01:22.835 DEBUG:teuthology.orchestra.run.trial077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T12:01:22.841 DEBUG:teuthology.orchestra.run.trial119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T12:01:22.853 DEBUG:teuthology.orchestra.run.trial077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:01:22.897 DEBUG:teuthology.orchestra.run.trial077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:01:22.944 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:01:22.944 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T12:01:22.995 DEBUG:teuthology.orchestra.run.trial119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:01:22.999 DEBUG:teuthology.orchestra.run.trial119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:01:23.047 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:01:23.047 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T12:01:23.099 DEBUG:teuthology.orchestra.run.trial077:> sudo service rsyslog restart 2026-02-17T12:01:23.100 DEBUG:teuthology.orchestra.run.trial119:> sudo service rsyslog restart 2026-02-17T12:01:23.159 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T12:01:23.171 INFO:teuthology.task.internal:Starting timer... 2026-02-17T12:01:23.171 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T12:01:23.192 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T12:01:23.211 DEBUG:teuthology.task.selinux:Excluding trial077: OS 'ubuntu' does not support SELinux 2026-02-17T12:01:23.211 DEBUG:teuthology.task.selinux:Excluding trial119: OS 'ubuntu' does not support SELinux 2026-02-17T12:01:23.211 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T12:01:23.211 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-17T12:01:23.212 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T12:01:23.212 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T12:01:23.226 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T12:01:23.237 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T12:01:23.238 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial077.front.sepia.ceph.com,trial119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T12:03:44.393 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial077.front.sepia.ceph.com'), Remote(name='ubuntu@trial119.front.sepia.ceph.com')] 2026-02-17T12:03:44.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial077.front.sepia.ceph.com' 2026-02-17T12:03:44.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:03:44.502 DEBUG:teuthology.orchestra.run.trial077:> true 2026-02-17T12:03:44.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial077.front.sepia.ceph.com' 2026-02-17T12:03:44.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-17T12:03:44.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:03:44.857 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-17T12:03:45.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-17T12:03:45.106 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T12:03:45.122 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T12:03:45.122 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T12:03:45.122 DEBUG:teuthology.orchestra.run.trial077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:03:45.125 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T12:03:45.125 DEBUG:teuthology.orchestra.run.trial119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:03:45.141 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-17T12:03:45.141 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: Command line: ntpd -gq 2026-02-17T12:03:45.141 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: ---------------------------------------------------- 2026-02-17T12:03:45.141 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: ntp-4 is maintained by Network Time Foundation, 2026-02-17T12:03:45.141 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-17T12:03:45.142 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: corporation. Support and training for ntp-4 are 2026-02-17T12:03:45.142 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: available at https://www.nwtime.org/support 2026-02-17T12:03:45.142 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: ---------------------------------------------------- 2026-02-17T12:03:45.142 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: proto: precision = 0.030 usec (-25) 2026-02-17T12:03:45.142 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: basedate set to 2022-02-04 2026-02-17T12:03:45.142 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: gps base set to 2022-02-06 (week 2196) 2026-02-17T12:03:45.142 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T12:03:45.143 INFO:teuthology.orchestra.run.trial077.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T12:03:45.143 INFO:teuthology.orchestra.run.trial077.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-17T12:03:45.144 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: restrict ::: KOD does nothing without LIMITED. 2026-02-17T12:03:45.144 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: Listen and drop on 0 v6wildcard [::]:123 2026-02-17T12:03:45.144 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-17T12:03:45.144 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: Listen normally on 2 lo 127.0.0.1:123 2026-02-17T12:03:45.144 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: Listen normally on 3 enp1s0f0 10.20.193.77:123 2026-02-17T12:03:45.144 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: Listen normally on 4 lo [::1]:123 2026-02-17T12:03:45.144 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:6458%2]:123 2026-02-17T12:03:45.145 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:45 ntpd[8787]: Listening on routing socket on fd #22 for interface updates 2026-02-17T12:03:45.170 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-17T12:03:45.170 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: Command line: ntpd -gq 2026-02-17T12:03:45.170 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: ---------------------------------------------------- 2026-02-17T12:03:45.170 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: ntp-4 is maintained by Network Time Foundation, 2026-02-17T12:03:45.170 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-17T12:03:45.170 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: corporation. Support and training for ntp-4 are 2026-02-17T12:03:45.170 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: available at https://www.nwtime.org/support 2026-02-17T12:03:45.170 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: ---------------------------------------------------- 2026-02-17T12:03:45.171 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: proto: precision = 0.030 usec (-25) 2026-02-17T12:03:45.171 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: basedate set to 2022-02-04 2026-02-17T12:03:45.171 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: gps base set to 2022-02-06 (week 2196) 2026-02-17T12:03:45.171 INFO:teuthology.orchestra.run.trial119.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T12:03:45.172 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T12:03:45.172 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: restrict ::: KOD does nothing without LIMITED. 2026-02-17T12:03:45.172 INFO:teuthology.orchestra.run.trial119.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-17T12:03:45.173 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: Listen and drop on 0 v6wildcard [::]:123 2026-02-17T12:03:45.173 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-17T12:03:45.173 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: Listen normally on 2 lo 127.0.0.1:123 2026-02-17T12:03:45.173 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: Listen normally on 3 enp1s0f0 10.20.193.119:123 2026-02-17T12:03:45.174 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: Listen normally on 4 lo [::1]:123 2026-02-17T12:03:45.174 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:6132%2]:123 2026-02-17T12:03:45.174 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:45 ntpd[8772]: Listening on routing socket on fd #22 for interface updates 2026-02-17T12:03:46.141 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:46.141 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:46.141 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:46.141 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:46.141 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:46.141 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:46.144 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:46.144 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:46.144 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:46.144 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:46.149 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:46.149 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:46.149 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:46.150 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:46.153 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:46.153 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:46.153 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:46.153 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:46 ntpd[8787]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:47.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:47 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:47.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:47 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:47.236 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:47 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:47.236 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:47 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:47.236 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:47 ntpd[8772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:47.236 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:47 ntpd[8772]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:48.141 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:48.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:48.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:48.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:48.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:48.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:48.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:48.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:48.149 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:48.149 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:48.149 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:48.149 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:48.151 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:48.151 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:48.151 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:48.151 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:48.157 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:48.157 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:48.157 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:48.157 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:48.170 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:48.170 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:48.170 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:48.170 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:48 ntpd[8787]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:49.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:49 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:49.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:49 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:49.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:49 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:49.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:49 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:49.196 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:49 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:49.196 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:49 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:49.196 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:49 ntpd[8772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:49.196 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:49 ntpd[8772]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:49.236 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:49 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:49.237 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:49 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:49.237 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:49 ntpd[8772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:49.237 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:49 ntpd[8772]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:50.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:50.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:50.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:50.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:50.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:50.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:50.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:50.143 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:50.144 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:50.144 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:50.144 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:50.145 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:50.149 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:50.150 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:50.150 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:50.150 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:50.154 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:50.154 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:50.155 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:50.155 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:50.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:50 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:50.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:50 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:50.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:50 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:50.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:50 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:50.171 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:50.171 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:50.171 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:50.171 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:50 ntpd[8787]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:50.175 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:50 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:50.175 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:50 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:50.175 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:50 ntpd[8772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:50.176 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:50 ntpd[8772]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:50.250 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:50 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:50.250 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:50 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:50.250 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:50 ntpd[8772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:50.251 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:50 ntpd[8772]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:51.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:51 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:51.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:51 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:51.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:51 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:51.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:51 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:51.195 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:51 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:51.195 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:51 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:51.196 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:51 ntpd[8772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:51.196 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:51 ntpd[8772]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:51.237 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:51 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:51.237 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:51 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:51.237 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:51 ntpd[8772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:51.237 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:51 ntpd[8772]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:52.141 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:52 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:52.141 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:52 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:52.141 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:52 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:52.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:52 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:52.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:52 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:52.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:52 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:52.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:52 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:52.142 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:52 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:52.144 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:52 ntpd[8787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:52.144 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:52 ntpd[8787]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:52.144 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:52 ntpd[8787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:52.144 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:52 ntpd[8787]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:52.145 INFO:teuthology.orchestra.run.trial077.stdout:17 Feb 12:03:52 ntpd[8787]: ntpd: time set -0.284416 s 2026-02-17T12:03:52.145 INFO:teuthology.orchestra.run.trial077.stdout:ntpd: time set -0.284416s 2026-02-17T12:03:52.145 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:52 ntpd[8787]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-17T12:03:52.145 INFO:teuthology.orchestra.run.trial077.stderr:17 Feb 12:03:52 ntpd[8787]: can't open /var/log/ntpstats/loopstats.20260217: Permission denied 2026-02-17T12:03:52.169 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:52 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:52.169 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:52 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:52.169 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:52 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:52.169 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:52 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:52.174 INFO:teuthology.orchestra.run.trial077.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T12:03:52.174 INFO:teuthology.orchestra.run.trial077.stdout:============================================================================== 2026-02-17T12:03:52.174 INFO:teuthology.orchestra.run.trial077.stdout: 172-104-28-175. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T12:03:52.183 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:52 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:52.183 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:52 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:52.184 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:52 ntpd[8772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:52.184 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:52 ntpd[8772]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:52.251 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:52 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:52.251 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:52 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:52.251 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:52 ntpd[8772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:52.251 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:52 ntpd[8772]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:53.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:53 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:53.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:53 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:53.170 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:53 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:53.171 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:53 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:53.195 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:53 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:53.195 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:53 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:53.195 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:53 ntpd[8772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:53.195 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:53 ntpd[8772]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:53.236 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:53 ntpd[8772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T12:03:53.236 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:53 ntpd[8772]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T12:03:53.236 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:53 ntpd[8772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T12:03:53.236 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:53 ntpd[8772]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T12:03:53.236 INFO:teuthology.orchestra.run.trial119.stdout:17 Feb 12:03:53 ntpd[8772]: ntpd: time set -0.292842 s 2026-02-17T12:03:53.236 INFO:teuthology.orchestra.run.trial119.stdout:ntpd: time set -0.292842s 2026-02-17T12:03:53.236 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:53 ntpd[8772]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-17T12:03:53.236 INFO:teuthology.orchestra.run.trial119.stderr:17 Feb 12:03:53 ntpd[8772]: can't open /var/log/ntpstats/loopstats.20260217: Permission denied 2026-02-17T12:03:53.301 INFO:teuthology.orchestra.run.trial119.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T12:03:53.302 INFO:teuthology.orchestra.run.trial119.stdout:============================================================================== 2026-02-17T12:03:53.302 INFO:teuthology.orchestra.run.trial119.stdout: ntp6.kernfusion .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T12:03:53.302 INFO:teuthology.orchestra.run.trial119.stdout: time-usw2.crimp .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T12:03:53.302 INFO:teuthology.orchestra.run.trial119.stdout: 144.202.41.38 ( .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T12:03:53.302 INFO:teuthology.orchestra.run.trial119.stdout: 23.186.168.133 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T12:03:53.303 INFO:teuthology.run_tasks:Running task install... 2026-02-17T12:03:53.321 DEBUG:teuthology.task.install:project ceph 2026-02-17T12:03:53.321 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}} 2026-02-17T12:03:53.321 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'} 2026-02-17T12:03:53.322 INFO:teuthology.task.install:Using flavor: default 2026-02-17T12:03:53.337 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T12:03:53.337 INFO:teuthology.task.install:extra packages: [] 2026-02-17T12:03:53.338 DEBUG:teuthology.orchestra.run.trial077:> sudo apt-key list | grep Ceph 2026-02-17T12:03:53.339 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-key list | grep Ceph 2026-02-17T12:03:53.385 INFO:teuthology.orchestra.run.trial077.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-17T12:03:53.397 INFO:teuthology.orchestra.run.trial119.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-17T12:03:53.412 INFO:teuthology.orchestra.run.trial077.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-17T12:03:53.412 INFO:teuthology.orchestra.run.trial077.stdout:uid [ unknown] Ceph.com (release key) 2026-02-17T12:03:53.414 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-17T12:03:53.414 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:03:53.434 INFO:teuthology.orchestra.run.trial119.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-17T12:03:53.434 INFO:teuthology.orchestra.run.trial119.stdout:uid [ unknown] Ceph.com (release key) 2026-02-17T12:03:53.434 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-17T12:03:53.435 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:03:53.642 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default/ 2026-02-17T12:03:53.642 INFO:teuthology.task.install.deb:Package version is 19.2.3-675-g3c96dfb3-1jammy 2026-02-17T12:03:53.657 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default/ 2026-02-17T12:03:53.657 INFO:teuthology.task.install.deb:Package version is 19.2.3-675-g3c96dfb3-1jammy 2026-02-17T12:03:53.811 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:03:53.811 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-17T12:03:53.820 DEBUG:teuthology.orchestra.run.trial077:> sudo apt-get update 2026-02-17T12:03:53.823 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:03:53.823 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-17T12:03:53.833 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-get update 2026-02-17T12:03:53.987 INFO:teuthology.orchestra.run.trial119.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy InRelease 2026-02-17T12:03:53.988 INFO:teuthology.orchestra.run.trial077.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy InRelease 2026-02-17T12:03:53.998 INFO:teuthology.orchestra.run.trial119.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy Release [6978 B] 2026-02-17T12:03:54.000 INFO:teuthology.orchestra.run.trial077.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy Release [6978 B] 2026-02-17T12:03:54.009 INFO:teuthology.orchestra.run.trial119.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-17T12:03:54.011 INFO:teuthology.orchestra.run.trial077.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-17T12:03:54.021 INFO:teuthology.orchestra.run.trial119.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2026-02-17T12:03:54.023 INFO:teuthology.orchestra.run.trial077.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2026-02-17T12:03:54.336 INFO:teuthology.orchestra.run.trial077.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T12:03:54.340 INFO:teuthology.orchestra.run.trial119.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T12:03:54.418 INFO:teuthology.orchestra.run.trial077.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T12:03:54.423 INFO:teuthology.orchestra.run.trial119.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T12:03:54.506 INFO:teuthology.orchestra.run.trial077.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T12:03:54.514 INFO:teuthology.orchestra.run.trial119.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T12:03:54.595 INFO:teuthology.orchestra.run.trial077.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T12:03:54.602 INFO:teuthology.orchestra.run.trial119.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T12:03:54.738 INFO:teuthology.orchestra.run.trial077.stdout:Fetched 25.1 kB in 1s (33.1 kB/s) 2026-02-17T12:03:54.744 INFO:teuthology.orchestra.run.trial119.stdout:Fetched 25.1 kB in 1s (33.5 kB/s) 2026-02-17T12:03:55.258 INFO:teuthology.orchestra.run.trial077.stdout:Reading package lists... 2026-02-17T12:03:55.269 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-17T12:03:55.271 DEBUG:teuthology.orchestra.run.trial077:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.2.3-675-g3c96dfb3-1jammy cephadm=19.2.3-675-g3c96dfb3-1jammy ceph-mds=19.2.3-675-g3c96dfb3-1jammy ceph-mgr=19.2.3-675-g3c96dfb3-1jammy ceph-common=19.2.3-675-g3c96dfb3-1jammy ceph-fuse=19.2.3-675-g3c96dfb3-1jammy ceph-test=19.2.3-675-g3c96dfb3-1jammy ceph-volume=19.2.3-675-g3c96dfb3-1jammy radosgw=19.2.3-675-g3c96dfb3-1jammy python3-rados=19.2.3-675-g3c96dfb3-1jammy python3-rgw=19.2.3-675-g3c96dfb3-1jammy python3-cephfs=19.2.3-675-g3c96dfb3-1jammy python3-rbd=19.2.3-675-g3c96dfb3-1jammy libcephfs2=19.2.3-675-g3c96dfb3-1jammy libcephfs-dev=19.2.3-675-g3c96dfb3-1jammy librados2=19.2.3-675-g3c96dfb3-1jammy librbd1=19.2.3-675-g3c96dfb3-1jammy rbd-fuse=19.2.3-675-g3c96dfb3-1jammy 2026-02-17T12:03:55.282 DEBUG:teuthology.orchestra.run.trial119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.2.3-675-g3c96dfb3-1jammy cephadm=19.2.3-675-g3c96dfb3-1jammy ceph-mds=19.2.3-675-g3c96dfb3-1jammy ceph-mgr=19.2.3-675-g3c96dfb3-1jammy ceph-common=19.2.3-675-g3c96dfb3-1jammy ceph-fuse=19.2.3-675-g3c96dfb3-1jammy ceph-test=19.2.3-675-g3c96dfb3-1jammy ceph-volume=19.2.3-675-g3c96dfb3-1jammy radosgw=19.2.3-675-g3c96dfb3-1jammy python3-rados=19.2.3-675-g3c96dfb3-1jammy python3-rgw=19.2.3-675-g3c96dfb3-1jammy python3-cephfs=19.2.3-675-g3c96dfb3-1jammy python3-rbd=19.2.3-675-g3c96dfb3-1jammy libcephfs2=19.2.3-675-g3c96dfb3-1jammy libcephfs-dev=19.2.3-675-g3c96dfb3-1jammy librados2=19.2.3-675-g3c96dfb3-1jammy librbd1=19.2.3-675-g3c96dfb3-1jammy rbd-fuse=19.2.3-675-g3c96dfb3-1jammy 2026-02-17T12:03:55.304 INFO:teuthology.orchestra.run.trial077.stdout:Reading package lists... 2026-02-17T12:03:55.315 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-17T12:03:55.414 INFO:teuthology.orchestra.run.trial077.stdout:Building dependency tree... 2026-02-17T12:03:55.414 INFO:teuthology.orchestra.run.trial077.stdout:Reading state information... 2026-02-17T12:03:55.425 INFO:teuthology.orchestra.run.trial119.stdout:Building dependency tree... 2026-02-17T12:03:55.426 INFO:teuthology.orchestra.run.trial119.stdout:Reading state information... 2026-02-17T12:03:55.503 INFO:teuthology.orchestra.run.trial077.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T12:03:55.503 INFO:teuthology.orchestra.run.trial077.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T12:03:55.503 INFO:teuthology.orchestra.run.trial077.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T12:03:55.503 INFO:teuthology.orchestra.run.trial077.stdout: sg3-utils-udev 2026-02-17T12:03:55.503 INFO:teuthology.orchestra.run.trial077.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T12:03:55.503 INFO:teuthology.orchestra.run.trial077.stdout:The following additional packages will be installed: 2026-02-17T12:03:55.503 INFO:teuthology.orchestra.run.trial077.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: pkg-config python-asyncssh-doc python-pastedeploy-tpl python3-asyncssh 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cheroot 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: python3-pyinotify python3-pytest python3-repoze.lru 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: python3-simplejson python3-singledispatch python3-sklearn 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: python3-toml python3-waitress python3-wcwidth python3-webob 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2026-02-17T12:03:55.504 INFO:teuthology.orchestra.run.trial077.stdout:Suggested packages: 2026-02-17T12:03:55.505 INFO:teuthology.orchestra.run.trial077.stdout: python3-influxdb readline-doc python3-beaker python-mako-doc 2026-02-17T12:03:55.505 INFO:teuthology.orchestra.run.trial077.stdout: python-natsort-doc httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2026-02-17T12:03:55.505 INFO:teuthology.orchestra.run.trial077.stdout: libjs-mochikit python-pecan-doc python-psutil-doc subversion 2026-02-17T12:03:55.505 INFO:teuthology.orchestra.run.trial077.stdout: python-pygments-doc ttf-bitstream-vera python-pyinotify-doc python3-dap 2026-02-17T12:03:55.505 INFO:teuthology.orchestra.run.trial077.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2026-02-17T12:03:55.505 INFO:teuthology.orchestra.run.trial077.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2026-02-17T12:03:55.505 INFO:teuthology.orchestra.run.trial077.stdout:Recommended packages: 2026-02-17T12:03:55.505 INFO:teuthology.orchestra.run.trial077.stdout: btrfs-tools 2026-02-17T12:03:55.517 INFO:teuthology.orchestra.run.trial119.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: sg3-utils-udev 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout:The following additional packages will be installed: 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: pkg-config python-asyncssh-doc python-pastedeploy-tpl python3-asyncssh 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cheroot 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyinotify python3-pytest python3-repoze.lru 2026-02-17T12:03:55.518 INFO:teuthology.orchestra.run.trial119.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2026-02-17T12:03:55.519 INFO:teuthology.orchestra.run.trial119.stdout: python3-simplejson python3-singledispatch python3-sklearn 2026-02-17T12:03:55.519 INFO:teuthology.orchestra.run.trial119.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2026-02-17T12:03:55.519 INFO:teuthology.orchestra.run.trial119.stdout: python3-toml python3-waitress python3-wcwidth python3-webob 2026-02-17T12:03:55.519 INFO:teuthology.orchestra.run.trial119.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2026-02-17T12:03:55.519 INFO:teuthology.orchestra.run.trial119.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2026-02-17T12:03:55.519 INFO:teuthology.orchestra.run.trial119.stdout:Suggested packages: 2026-02-17T12:03:55.519 INFO:teuthology.orchestra.run.trial119.stdout: python3-influxdb readline-doc python3-beaker python-mako-doc 2026-02-17T12:03:55.519 INFO:teuthology.orchestra.run.trial119.stdout: python-natsort-doc httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2026-02-17T12:03:55.519 INFO:teuthology.orchestra.run.trial119.stdout: libjs-mochikit python-pecan-doc python-psutil-doc subversion 2026-02-17T12:03:55.519 INFO:teuthology.orchestra.run.trial119.stdout: python-pygments-doc ttf-bitstream-vera python-pyinotify-doc python3-dap 2026-02-17T12:03:55.519 INFO:teuthology.orchestra.run.trial119.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2026-02-17T12:03:55.519 INFO:teuthology.orchestra.run.trial119.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2026-02-17T12:03:55.519 INFO:teuthology.orchestra.run.trial119.stdout:Recommended packages: 2026-02-17T12:03:55.519 INFO:teuthology.orchestra.run.trial119.stdout: btrfs-tools 2026-02-17T12:03:55.538 INFO:teuthology.orchestra.run.trial077.stdout:The following NEW packages will be installed: 2026-02-17T12:03:55.538 INFO:teuthology.orchestra.run.trial077.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-17T12:03:55.538 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-17T12:03:55.538 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-17T12:03:55.538 INFO:teuthology.orchestra.run.trial077.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 2026-02-17T12:03:55.538 INFO:teuthology.orchestra.run.trial077.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-17T12:03:55.538 INFO:teuthology.orchestra.run.trial077.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2026-02-17T12:03:55.539 INFO:teuthology.orchestra.run.trial077.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2026-02-17T12:03:55.539 INFO:teuthology.orchestra.run.trial077.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2026-02-17T12:03:55.539 INFO:teuthology.orchestra.run.trial077.stdout: python-pastedeploy-tpl python3-asyncssh python3-cachetools 2026-02-17T12:03:55.539 INFO:teuthology.orchestra.run.trial077.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cheroot 2026-02-17T12:03:55.539 INFO:teuthology.orchestra.run.trial077.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T12:03:55.539 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T12:03:55.539 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T12:03:55.539 INFO:teuthology.orchestra.run.trial077.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T12:03:55.539 INFO:teuthology.orchestra.run.trial077.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T12:03:55.539 INFO:teuthology.orchestra.run.trial077.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T12:03:55.540 INFO:teuthology.orchestra.run.trial077.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2026-02-17T12:03:55.540 INFO:teuthology.orchestra.run.trial077.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2026-02-17T12:03:55.540 INFO:teuthology.orchestra.run.trial077.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2026-02-17T12:03:55.540 INFO:teuthology.orchestra.run.trial077.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2026-02-17T12:03:55.540 INFO:teuthology.orchestra.run.trial077.stdout: python3-threadpoolctl python3-toml python3-waitress python3-wcwidth 2026-02-17T12:03:55.540 INFO:teuthology.orchestra.run.trial077.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2026-02-17T12:03:55.540 INFO:teuthology.orchestra.run.trial077.stdout: python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse socat unzip 2026-02-17T12:03:55.540 INFO:teuthology.orchestra.run.trial077.stdout: xmlstarlet zip 2026-02-17T12:03:55.552 INFO:teuthology.orchestra.run.trial119.stdout:The following NEW packages will be installed: 2026-02-17T12:03:55.552 INFO:teuthology.orchestra.run.trial119.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-17T12:03:55.553 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-17T12:03:55.553 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-17T12:03:55.553 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 2026-02-17T12:03:55.553 INFO:teuthology.orchestra.run.trial119.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-17T12:03:55.553 INFO:teuthology.orchestra.run.trial119.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2026-02-17T12:03:55.553 INFO:teuthology.orchestra.run.trial119.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2026-02-17T12:03:55.553 INFO:teuthology.orchestra.run.trial119.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2026-02-17T12:03:55.553 INFO:teuthology.orchestra.run.trial119.stdout: python-pastedeploy-tpl python3-asyncssh python3-cachetools 2026-02-17T12:03:55.553 INFO:teuthology.orchestra.run.trial119.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cheroot 2026-02-17T12:03:55.553 INFO:teuthology.orchestra.run.trial119.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T12:03:55.553 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T12:03:55.553 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T12:03:55.554 INFO:teuthology.orchestra.run.trial119.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T12:03:55.554 INFO:teuthology.orchestra.run.trial119.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T12:03:55.554 INFO:teuthology.orchestra.run.trial119.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T12:03:55.554 INFO:teuthology.orchestra.run.trial119.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2026-02-17T12:03:55.554 INFO:teuthology.orchestra.run.trial119.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2026-02-17T12:03:55.554 INFO:teuthology.orchestra.run.trial119.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2026-02-17T12:03:55.554 INFO:teuthology.orchestra.run.trial119.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2026-02-17T12:03:55.554 INFO:teuthology.orchestra.run.trial119.stdout: python3-threadpoolctl python3-toml python3-waitress python3-wcwidth 2026-02-17T12:03:55.554 INFO:teuthology.orchestra.run.trial119.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2026-02-17T12:03:55.555 INFO:teuthology.orchestra.run.trial119.stdout: python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse socat unzip 2026-02-17T12:03:55.555 INFO:teuthology.orchestra.run.trial119.stdout: xmlstarlet zip 2026-02-17T12:03:55.616 INFO:teuthology.orchestra.run.trial077.stdout:0 upgraded, 108 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T12:03:55.617 INFO:teuthology.orchestra.run.trial077.stdout:Need to get 178 MB of archives. 2026-02-17T12:03:55.617 INFO:teuthology.orchestra.run.trial077.stdout:After this operation, 809 MB of additional disk space will be used. 2026-02-17T12:03:55.617 INFO:teuthology.orchestra.run.trial077.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.2.3-675-g3c96dfb3-1jammy [3597 kB] 2026-02-17T12:03:55.631 INFO:teuthology.orchestra.run.trial119.stdout:0 upgraded, 108 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T12:03:55.631 INFO:teuthology.orchestra.run.trial119.stdout:Need to get 178 MB of archives. 2026-02-17T12:03:55.632 INFO:teuthology.orchestra.run.trial119.stdout:After this operation, 809 MB of additional disk space will be used. 2026-02-17T12:03:55.632 INFO:teuthology.orchestra.run.trial119.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.2.3-675-g3c96dfb3-1jammy [3597 kB] 2026-02-17T12:03:55.754 INFO:teuthology.orchestra.run.trial077.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.2.3-675-g3c96dfb3-1jammy [3257 kB] 2026-02-17T12:03:55.781 INFO:teuthology.orchestra.run.trial119.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.2.3-675-g3c96dfb3-1jammy [3257 kB] 2026-02-17T12:03:55.847 INFO:teuthology.orchestra.run.trial077.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.2.3-675-g3c96dfb3-1jammy [979 kB] 2026-02-17T12:03:55.876 INFO:teuthology.orchestra.run.trial077.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.2.3-675-g3c96dfb3-1jammy [356 kB] 2026-02-17T12:03:55.882 INFO:teuthology.orchestra.run.trial077.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.2.3-675-g3c96dfb3-1jammy [32.9 kB] 2026-02-17T12:03:55.883 INFO:teuthology.orchestra.run.trial077.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.2.3-675-g3c96dfb3-1jammy [184 kB] 2026-02-17T12:03:55.886 INFO:teuthology.orchestra.run.trial077.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.2.3-675-g3c96dfb3-1jammy [70.1 kB] 2026-02-17T12:03:55.890 INFO:teuthology.orchestra.run.trial077.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.2.3-675-g3c96dfb3-1jammy [336 kB] 2026-02-17T12:03:55.891 INFO:teuthology.orchestra.run.trial119.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.2.3-675-g3c96dfb3-1jammy [979 kB] 2026-02-17T12:03:55.906 INFO:teuthology.orchestra.run.trial077.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.2.3-675-g3c96dfb3-1jammy [6935 kB] 2026-02-17T12:03:55.910 INFO:teuthology.orchestra.run.trial119.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-17T12:03:55.923 INFO:teuthology.orchestra.run.trial119.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.2.3-675-g3c96dfb3-1jammy [356 kB] 2026-02-17T12:03:55.928 INFO:teuthology.orchestra.run.trial119.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.2.3-675-g3c96dfb3-1jammy [32.9 kB] 2026-02-17T12:03:55.929 INFO:teuthology.orchestra.run.trial119.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.2.3-675-g3c96dfb3-1jammy [184 kB] 2026-02-17T12:03:55.947 INFO:teuthology.orchestra.run.trial119.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.2.3-675-g3c96dfb3-1jammy [70.1 kB] 2026-02-17T12:03:55.948 INFO:teuthology.orchestra.run.trial119.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.2.3-675-g3c96dfb3-1jammy [336 kB] 2026-02-17T12:03:55.954 INFO:teuthology.orchestra.run.trial077.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-17T12:03:55.955 INFO:teuthology.orchestra.run.trial119.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.2.3-675-g3c96dfb3-1jammy [6935 kB] 2026-02-17T12:03:56.121 INFO:teuthology.orchestra.run.trial077.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.2.3-675-g3c96dfb3-1jammy [112 kB] 2026-02-17T12:03:56.122 INFO:teuthology.orchestra.run.trial077.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.2.3-675-g3c96dfb3-1jammy [470 kB] 2026-02-17T12:03:56.149 INFO:teuthology.orchestra.run.trial077.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.2.3-675-g3c96dfb3-1jammy [26.5 MB] 2026-02-17T12:03:56.187 INFO:teuthology.orchestra.run.trial119.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.2.3-675-g3c96dfb3-1jammy [112 kB] 2026-02-17T12:03:56.187 INFO:teuthology.orchestra.run.trial119.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.2.3-675-g3c96dfb3-1jammy [470 kB] 2026-02-17T12:03:56.216 INFO:teuthology.orchestra.run.trial119.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.2.3-675-g3c96dfb3-1jammy [26.5 MB] 2026-02-17T12:03:56.248 INFO:teuthology.orchestra.run.trial119.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-17T12:03:56.259 INFO:teuthology.orchestra.run.trial119.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-17T12:03:56.328 INFO:teuthology.orchestra.run.trial119.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-17T12:03:56.368 INFO:teuthology.orchestra.run.trial077.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-17T12:03:56.382 INFO:teuthology.orchestra.run.trial077.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-17T12:03:56.467 INFO:teuthology.orchestra.run.trial077.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-17T12:03:56.529 INFO:teuthology.orchestra.run.trial119.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-17T12:03:56.539 INFO:teuthology.orchestra.run.trial119.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-17T12:03:56.566 INFO:teuthology.orchestra.run.trial119.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-17T12:03:56.574 INFO:teuthology.orchestra.run.trial119.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-17T12:03:56.576 INFO:teuthology.orchestra.run.trial119.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-17T12:03:56.577 INFO:teuthology.orchestra.run.trial119.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-17T12:03:56.578 INFO:teuthology.orchestra.run.trial119.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-17T12:03:56.595 INFO:teuthology.orchestra.run.trial119.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2026-02-17T12:03:56.598 INFO:teuthology.orchestra.run.trial119.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2026-02-17T12:03:56.602 INFO:teuthology.orchestra.run.trial119.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2026-02-17T12:03:56.671 INFO:teuthology.orchestra.run.trial119.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5034 B] 2026-02-17T12:03:56.671 INFO:teuthology.orchestra.run.trial119.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2026-02-17T12:03:56.673 INFO:teuthology.orchestra.run.trial119.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2026-02-17T12:03:56.675 INFO:teuthology.orchestra.run.trial119.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2026-02-17T12:03:56.676 INFO:teuthology.orchestra.run.trial119.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-17T12:03:56.677 INFO:teuthology.orchestra.run.trial119.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-17T12:03:56.677 INFO:teuthology.orchestra.run.trial119.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-17T12:03:56.678 INFO:teuthology.orchestra.run.trial119.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-17T12:03:56.713 INFO:teuthology.orchestra.run.trial077.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-17T12:03:56.726 INFO:teuthology.orchestra.run.trial077.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-17T12:03:56.748 INFO:teuthology.orchestra.run.trial119.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-17T12:03:56.748 INFO:teuthology.orchestra.run.trial119.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-17T12:03:56.749 INFO:teuthology.orchestra.run.trial119.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-17T12:03:56.749 INFO:teuthology.orchestra.run.trial119.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-17T12:03:56.749 INFO:teuthology.orchestra.run.trial119.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-17T12:03:56.758 INFO:teuthology.orchestra.run.trial077.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-17T12:03:56.768 INFO:teuthology.orchestra.run.trial077.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-17T12:03:56.770 INFO:teuthology.orchestra.run.trial077.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-17T12:03:56.771 INFO:teuthology.orchestra.run.trial077.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-17T12:03:56.773 INFO:teuthology.orchestra.run.trial077.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-17T12:03:56.793 INFO:teuthology.orchestra.run.trial077.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2026-02-17T12:03:56.797 INFO:teuthology.orchestra.run.trial077.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2026-02-17T12:03:56.802 INFO:teuthology.orchestra.run.trial077.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2026-02-17T12:03:56.820 INFO:teuthology.orchestra.run.trial119.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-17T12:03:56.823 INFO:teuthology.orchestra.run.trial119.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-17T12:03:56.823 INFO:teuthology.orchestra.run.trial119.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2026-02-17T12:03:56.823 INFO:teuthology.orchestra.run.trial119.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2026-02-17T12:03:56.824 INFO:teuthology.orchestra.run.trial119.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2026-02-17T12:03:56.886 INFO:teuthology.orchestra.run.trial077.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5034 B] 2026-02-17T12:03:56.886 INFO:teuthology.orchestra.run.trial077.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2026-02-17T12:03:56.888 INFO:teuthology.orchestra.run.trial077.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2026-02-17T12:03:56.891 INFO:teuthology.orchestra.run.trial077.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2026-02-17T12:03:56.893 INFO:teuthology.orchestra.run.trial119.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7320 B] 2026-02-17T12:03:56.893 INFO:teuthology.orchestra.run.trial119.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-17T12:03:56.894 INFO:teuthology.orchestra.run.trial077.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-17T12:03:56.894 INFO:teuthology.orchestra.run.trial077.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-17T12:03:56.894 INFO:teuthology.orchestra.run.trial077.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-17T12:03:56.894 INFO:teuthology.orchestra.run.trial119.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-waitress all 1.4.4-1.1ubuntu1.1 [47.0 kB] 2026-02-17T12:03:56.895 INFO:teuthology.orchestra.run.trial119.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2026-02-17T12:03:56.895 INFO:teuthology.orchestra.run.trial119.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2026-02-17T12:03:56.895 INFO:teuthology.orchestra.run.trial077.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-17T12:03:56.895 INFO:teuthology.orchestra.run.trial077.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-17T12:03:56.965 INFO:teuthology.orchestra.run.trial119.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4892 B] 2026-02-17T12:03:56.966 INFO:teuthology.orchestra.run.trial119.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2026-02-17T12:03:56.966 INFO:teuthology.orchestra.run.trial119.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2026-02-17T12:03:56.966 INFO:teuthology.orchestra.run.trial119.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2026-02-17T12:03:56.967 INFO:teuthology.orchestra.run.trial119.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.3 [181 kB] 2026-02-17T12:03:56.981 INFO:teuthology.orchestra.run.trial077.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-17T12:03:56.981 INFO:teuthology.orchestra.run.trial077.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial077.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-17T12:03:56.982 INFO:teuthology.orchestra.run.trial077.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-17T12:03:56.987 INFO:teuthology.orchestra.run.trial077.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.2.3-675-g3c96dfb3-1jammy [5178 kB] 2026-02-17T12:03:57.037 INFO:teuthology.orchestra.run.trial119.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-17T12:03:57.038 INFO:teuthology.orchestra.run.trial119.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-17T12:03:57.040 INFO:teuthology.orchestra.run.trial119.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-17T12:03:57.041 INFO:teuthology.orchestra.run.trial119.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-17T12:03:57.041 INFO:teuthology.orchestra.run.trial119.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-17T12:03:57.069 INFO:teuthology.orchestra.run.trial077.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-17T12:03:57.072 INFO:teuthology.orchestra.run.trial077.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-17T12:03:57.072 INFO:teuthology.orchestra.run.trial077.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2026-02-17T12:03:57.073 INFO:teuthology.orchestra.run.trial077.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2026-02-17T12:03:57.073 INFO:teuthology.orchestra.run.trial077.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2026-02-17T12:03:57.074 INFO:teuthology.orchestra.run.trial077.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7320 B] 2026-02-17T12:03:57.110 INFO:teuthology.orchestra.run.trial119.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-17T12:03:57.112 INFO:teuthology.orchestra.run.trial119.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-17T12:03:57.112 INFO:teuthology.orchestra.run.trial119.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-17T12:03:57.132 INFO:teuthology.orchestra.run.trial119.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-17T12:03:57.133 INFO:teuthology.orchestra.run.trial119.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-17T12:03:57.155 INFO:teuthology.orchestra.run.trial119.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.2.3-675-g3c96dfb3-1jammy [5178 kB] 2026-02-17T12:03:57.157 INFO:teuthology.orchestra.run.trial077.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-17T12:03:57.158 INFO:teuthology.orchestra.run.trial077.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-waitress all 1.4.4-1.1ubuntu1.1 [47.0 kB] 2026-02-17T12:03:57.159 INFO:teuthology.orchestra.run.trial077.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2026-02-17T12:03:57.159 INFO:teuthology.orchestra.run.trial077.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2026-02-17T12:03:57.165 INFO:teuthology.orchestra.run.trial077.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.2.3-675-g3c96dfb3-1jammy [248 kB] 2026-02-17T12:03:57.168 INFO:teuthology.orchestra.run.trial077.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.2.3-675-g3c96dfb3-1jammy [124 kB] 2026-02-17T12:03:57.170 INFO:teuthology.orchestra.run.trial077.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.2.3-675-g3c96dfb3-1jammy [1081 kB] 2026-02-17T12:03:57.182 INFO:teuthology.orchestra.run.trial119.stdout:Get:66 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-17T12:03:57.182 INFO:teuthology.orchestra.run.trial119.stdout:Get:67 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-17T12:03:57.182 INFO:teuthology.orchestra.run.trial119.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-17T12:03:57.183 INFO:teuthology.orchestra.run.trial119.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-17T12:03:57.186 INFO:teuthology.orchestra.run.trial119.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-17T12:03:57.210 INFO:teuthology.orchestra.run.trial077.stdout:Get:54 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.2.3-675-g3c96dfb3-1jammy [6239 kB] 2026-02-17T12:03:57.246 INFO:teuthology.orchestra.run.trial077.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4892 B] 2026-02-17T12:03:57.246 INFO:teuthology.orchestra.run.trial077.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2026-02-17T12:03:57.247 INFO:teuthology.orchestra.run.trial077.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2026-02-17T12:03:57.247 INFO:teuthology.orchestra.run.trial077.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2026-02-17T12:03:57.248 INFO:teuthology.orchestra.run.trial077.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.3 [181 kB] 2026-02-17T12:03:57.250 INFO:teuthology.orchestra.run.trial077.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-17T12:03:57.256 INFO:teuthology.orchestra.run.trial119.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-17T12:03:57.257 INFO:teuthology.orchestra.run.trial119.stdout:Get:72 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-17T12:03:57.257 INFO:teuthology.orchestra.run.trial119.stdout:Get:73 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-17T12:03:57.261 INFO:teuthology.orchestra.run.trial119.stdout:Get:74 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-17T12:03:57.263 INFO:teuthology.orchestra.run.trial119.stdout:Get:75 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2026-02-17T12:03:57.328 INFO:teuthology.orchestra.run.trial119.stdout:Get:76 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2026-02-17T12:03:57.329 INFO:teuthology.orchestra.run.trial119.stdout:Get:77 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-17T12:03:57.333 INFO:teuthology.orchestra.run.trial119.stdout:Get:78 https://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2026-02-17T12:03:57.333 INFO:teuthology.orchestra.run.trial119.stdout:Get:79 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-17T12:03:57.334 INFO:teuthology.orchestra.run.trial077.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-17T12:03:57.336 INFO:teuthology.orchestra.run.trial077.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-17T12:03:57.337 INFO:teuthology.orchestra.run.trial119.stdout:Get:80 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-17T12:03:57.337 INFO:teuthology.orchestra.run.trial077.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-17T12:03:57.338 INFO:teuthology.orchestra.run.trial077.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-17T12:03:57.366 INFO:teuthology.orchestra.run.trial119.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.2.3-675-g3c96dfb3-1jammy [248 kB] 2026-02-17T12:03:57.369 INFO:teuthology.orchestra.run.trial119.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.2.3-675-g3c96dfb3-1jammy [124 kB] 2026-02-17T12:03:57.371 INFO:teuthology.orchestra.run.trial119.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.2.3-675-g3c96dfb3-1jammy [1081 kB] 2026-02-17T12:03:57.400 INFO:teuthology.orchestra.run.trial119.stdout:Get:84 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2026-02-17T12:03:57.401 INFO:teuthology.orchestra.run.trial119.stdout:Get:85 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-17T12:03:57.401 INFO:teuthology.orchestra.run.trial119.stdout:Get:86 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-17T12:03:57.402 INFO:teuthology.orchestra.run.trial119.stdout:Get:87 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-17T12:03:57.403 INFO:teuthology.orchestra.run.trial119.stdout:Get:88 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-17T12:03:57.416 INFO:teuthology.orchestra.run.trial119.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.2.3-675-g3c96dfb3-1jammy [6239 kB] 2026-02-17T12:03:57.422 INFO:teuthology.orchestra.run.trial077.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-17T12:03:57.424 INFO:teuthology.orchestra.run.trial077.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.2.3-675-g3c96dfb3-1jammy [23.0 MB] 2026-02-17T12:03:57.425 INFO:teuthology.orchestra.run.trial077.stdout:Get:67 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-17T12:03:57.425 INFO:teuthology.orchestra.run.trial077.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-17T12:03:57.450 INFO:teuthology.orchestra.run.trial077.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-17T12:03:57.450 INFO:teuthology.orchestra.run.trial077.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-17T12:03:57.451 INFO:teuthology.orchestra.run.trial077.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-17T12:03:57.473 INFO:teuthology.orchestra.run.trial119.stdout:Get:90 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2026-02-17T12:03:57.473 INFO:teuthology.orchestra.run.trial119.stdout:Get:91 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-17T12:03:57.473 INFO:teuthology.orchestra.run.trial119.stdout:Get:92 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-17T12:03:57.475 INFO:teuthology.orchestra.run.trial119.stdout:Get:93 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-17T12:03:57.476 INFO:teuthology.orchestra.run.trial119.stdout:Get:94 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-17T12:03:57.511 INFO:teuthology.orchestra.run.trial077.stdout:Get:72 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-17T12:03:57.511 INFO:teuthology.orchestra.run.trial077.stdout:Get:73 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-17T12:03:57.511 INFO:teuthology.orchestra.run.trial077.stdout:Get:74 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-17T12:03:57.515 INFO:teuthology.orchestra.run.trial077.stdout:Get:75 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-17T12:03:57.599 INFO:teuthology.orchestra.run.trial077.stdout:Get:76 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-17T12:03:57.600 INFO:teuthology.orchestra.run.trial077.stdout:Get:77 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-17T12:03:57.601 INFO:teuthology.orchestra.run.trial077.stdout:Get:78 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-17T12:03:57.605 INFO:teuthology.orchestra.run.trial077.stdout:Get:79 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-17T12:03:57.608 INFO:teuthology.orchestra.run.trial077.stdout:Get:80 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2026-02-17T12:03:57.609 INFO:teuthology.orchestra.run.trial077.stdout:Get:81 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2026-02-17T12:03:57.687 INFO:teuthology.orchestra.run.trial077.stdout:Get:82 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-17T12:03:57.692 INFO:teuthology.orchestra.run.trial119.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.2.3-675-g3c96dfb3-1jammy [23.0 MB] 2026-02-17T12:03:57.693 INFO:teuthology.orchestra.run.trial077.stdout:Get:83 https://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2026-02-17T12:03:57.693 INFO:teuthology.orchestra.run.trial077.stdout:Get:84 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-17T12:03:57.697 INFO:teuthology.orchestra.run.trial077.stdout:Get:85 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-17T12:03:57.776 INFO:teuthology.orchestra.run.trial077.stdout:Get:86 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2026-02-17T12:03:57.776 INFO:teuthology.orchestra.run.trial077.stdout:Get:87 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-17T12:03:57.776 INFO:teuthology.orchestra.run.trial077.stdout:Get:88 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-17T12:03:57.778 INFO:teuthology.orchestra.run.trial077.stdout:Get:89 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-17T12:03:57.779 INFO:teuthology.orchestra.run.trial077.stdout:Get:90 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-17T12:03:57.788 INFO:teuthology.orchestra.run.trial077.stdout:Get:91 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2026-02-17T12:03:57.864 INFO:teuthology.orchestra.run.trial077.stdout:Get:92 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-17T12:03:57.864 INFO:teuthology.orchestra.run.trial077.stdout:Get:93 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-17T12:03:57.866 INFO:teuthology.orchestra.run.trial077.stdout:Get:94 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-17T12:03:57.867 INFO:teuthology.orchestra.run.trial077.stdout:Get:95 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-17T12:03:58.254 INFO:teuthology.orchestra.run.trial077.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.2.3-675-g3c96dfb3-1jammy [14.2 kB] 2026-02-17T12:03:58.254 INFO:teuthology.orchestra.run.trial077.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.2.3-675-g3c96dfb3-1jammy [1173 kB] 2026-02-17T12:03:58.303 INFO:teuthology.orchestra.run.trial077.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.2.3-675-g3c96dfb3-1jammy [2503 kB] 2026-02-17T12:03:58.380 INFO:teuthology.orchestra.run.trial077.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.2.3-675-g3c96dfb3-1jammy [798 kB] 2026-02-17T12:03:58.429 INFO:teuthology.orchestra.run.trial077.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.2.3-675-g3c96dfb3-1jammy [157 kB] 2026-02-17T12:03:58.431 INFO:teuthology.orchestra.run.trial077.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.2.3-675-g3c96dfb3-1jammy [2396 kB] 2026-02-17T12:03:58.510 INFO:teuthology.orchestra.run.trial077.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.2.3-675-g3c96dfb3-1jammy [8625 kB] 2026-02-17T12:03:58.732 INFO:teuthology.orchestra.run.trial119.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.2.3-675-g3c96dfb3-1jammy [14.2 kB] 2026-02-17T12:03:58.733 INFO:teuthology.orchestra.run.trial119.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.2.3-675-g3c96dfb3-1jammy [1173 kB] 2026-02-17T12:03:58.794 INFO:teuthology.orchestra.run.trial119.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.2.3-675-g3c96dfb3-1jammy [2503 kB] 2026-02-17T12:03:58.933 INFO:teuthology.orchestra.run.trial119.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.2.3-675-g3c96dfb3-1jammy [798 kB] 2026-02-17T12:03:58.951 INFO:teuthology.orchestra.run.trial119.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.2.3-675-g3c96dfb3-1jammy [157 kB] 2026-02-17T12:03:58.957 INFO:teuthology.orchestra.run.trial119.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.2.3-675-g3c96dfb3-1jammy [2396 kB] 2026-02-17T12:03:58.965 INFO:teuthology.orchestra.run.trial077.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.2.3-675-g3c96dfb3-1jammy [14.3 kB] 2026-02-17T12:03:58.965 INFO:teuthology.orchestra.run.trial077.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.2.3-675-g3c96dfb3-1jammy [52.1 MB] 2026-02-17T12:03:59.075 INFO:teuthology.orchestra.run.trial119.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.2.3-675-g3c96dfb3-1jammy [8625 kB] 2026-02-17T12:03:59.447 INFO:teuthology.orchestra.run.trial119.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.2.3-675-g3c96dfb3-1jammy [14.3 kB] 2026-02-17T12:03:59.448 INFO:teuthology.orchestra.run.trial119.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.2.3-675-g3c96dfb3-1jammy [52.1 MB] 2026-02-17T12:04:01.430 INFO:teuthology.orchestra.run.trial119.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.2.3-675-g3c96dfb3-1jammy [135 kB] 2026-02-17T12:04:01.431 INFO:teuthology.orchestra.run.trial119.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.2.3-675-g3c96dfb3-1jammy [41.0 kB] 2026-02-17T12:04:01.431 INFO:teuthology.orchestra.run.trial119.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.2.3-675-g3c96dfb3-1jammy [13.7 MB] 2026-02-17T12:04:01.919 INFO:teuthology.orchestra.run.trial119.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.2.3-675-g3c96dfb3-1jammy [92.1 kB] 2026-02-17T12:04:02.127 INFO:teuthology.orchestra.run.trial077.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.2.3-675-g3c96dfb3-1jammy [135 kB] 2026-02-17T12:04:02.128 INFO:teuthology.orchestra.run.trial077.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.2.3-675-g3c96dfb3-1jammy [41.0 kB] 2026-02-17T12:04:02.132 INFO:teuthology.orchestra.run.trial077.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.2.3-675-g3c96dfb3-1jammy [13.7 MB] 2026-02-17T12:04:02.244 INFO:teuthology.orchestra.run.trial119.stdout:Fetched 178 MB in 6s (27.9 MB/s) 2026-02-17T12:04:02.262 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-17T12:04:02.422 INFO:teuthology.orchestra.run.trial119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-17T12:04:02.424 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-17T12:04:02.425 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T12:04:02.446 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-17T12:04:02.458 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-17T12:04:02.459 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T12:04:02.474 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-17T12:04:02.486 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-17T12:04:02.486 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T12:04:02.505 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-17T12:04:02.514 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T12:04:02.519 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T12:04:02.550 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-17T12:04:02.558 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T12:04:02.559 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T12:04:02.574 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-17T12:04:02.582 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T12:04:02.583 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T12:04:02.603 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-17T12:04:02.611 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-17T12:04:02.611 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T12:04:02.628 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package librados2. 2026-02-17T12:04:02.636 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../007-librados2_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:02.637 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking librados2 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:02.678 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libnbd0. 2026-02-17T12:04:02.684 INFO:teuthology.orchestra.run.trial077.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.2.3-675-g3c96dfb3-1jammy [92.1 kB] 2026-02-17T12:04:02.686 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2026-02-17T12:04:02.686 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-17T12:04:02.701 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package librbd1. 2026-02-17T12:04:02.709 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../009-librbd1_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:02.710 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking librbd1 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:02.752 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libcephfs2. 2026-02-17T12:04:02.760 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../010-libcephfs2_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:02.760 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libcephfs2 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:02.782 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-rados. 2026-02-17T12:04:02.790 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../011-python3-rados_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:02.790 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-rados (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:02.807 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-17T12:04:02.815 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:02.816 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-ceph-argparse (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:02.829 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-cephfs. 2026-02-17T12:04:02.837 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../013-python3-cephfs_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:02.838 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-cephfs (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:02.853 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-17T12:04:02.861 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../014-python3-ceph-common_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:02.861 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-ceph-common (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:02.878 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-17T12:04:02.886 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-17T12:04:02.886 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T12:04:02.902 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-prettytable. 2026-02-17T12:04:02.910 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2026-02-17T12:04:02.910 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-17T12:04:02.924 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-rbd. 2026-02-17T12:04:02.932 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../017-python3-rbd_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:02.933 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-rbd (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:02.950 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-17T12:04:02.958 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-17T12:04:02.958 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T12:04:02.976 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libreadline-dev:amd64. 2026-02-17T12:04:02.984 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2026-02-17T12:04:02.984 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T12:04:03.001 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2026-02-17T12:04:03.006 INFO:teuthology.orchestra.run.trial077.stdout:Fetched 178 MB in 7s (24.9 MB/s) 2026-02-17T12:04:03.009 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2026-02-17T12:04:03.009 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T12:04:03.022 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-17T12:04:03.027 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package lua5.1. 2026-02-17T12:04:03.035 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2026-02-17T12:04:03.035 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2026-02-17T12:04:03.056 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package lua-any. 2026-02-17T12:04:03.064 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2026-02-17T12:04:03.065 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking lua-any (27ubuntu1) ... 2026-02-17T12:04:03.079 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package zip. 2026-02-17T12:04:03.086 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2026-02-17T12:04:03.087 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking zip (3.0-12build2) ... 2026-02-17T12:04:03.104 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package unzip. 2026-02-17T12:04:03.112 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2026-02-17T12:04:03.113 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2026-02-17T12:04:03.129 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package luarocks. 2026-02-17T12:04:03.136 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2026-02-17T12:04:03.137 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2026-02-17T12:04:03.175 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package librgw2. 2026-02-17T12:04:03.177 INFO:teuthology.orchestra.run.trial077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-17T12:04:03.179 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-17T12:04:03.180 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T12:04:03.183 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../026-librgw2_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:03.183 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking librgw2 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:03.198 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-17T12:04:03.211 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-17T12:04:03.211 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T12:04:03.228 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-17T12:04:03.240 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-17T12:04:03.241 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T12:04:03.256 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-rgw. 2026-02-17T12:04:03.259 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-17T12:04:03.265 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../027-python3-rgw_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:03.265 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-rgw (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:03.267 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T12:04:03.273 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T12:04:03.281 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-17T12:04:03.288 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../028-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-17T12:04:03.289 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T12:04:03.302 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-17T12:04:03.303 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libradosstriper1. 2026-02-17T12:04:03.310 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T12:04:03.311 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T12:04:03.311 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../029-libradosstriper1_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:03.312 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libradosstriper1 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:03.328 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-17T12:04:03.330 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-common. 2026-02-17T12:04:03.336 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T12:04:03.336 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T12:04:03.338 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../030-ceph-common_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:03.339 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-common (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:03.356 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-17T12:04:03.364 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-17T12:04:03.364 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T12:04:03.381 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package librados2. 2026-02-17T12:04:03.388 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../007-librados2_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:03.389 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking librados2 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:03.429 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libnbd0. 2026-02-17T12:04:03.437 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2026-02-17T12:04:03.438 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-17T12:04:03.453 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package librbd1. 2026-02-17T12:04:03.461 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../009-librbd1_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:03.461 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking librbd1 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:03.502 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libcephfs2. 2026-02-17T12:04:03.510 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../010-libcephfs2_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:03.511 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libcephfs2 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:03.531 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-rados. 2026-02-17T12:04:03.539 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../011-python3-rados_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:03.539 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-rados (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:03.544 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-base. 2026-02-17T12:04:03.553 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../031-ceph-base_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:03.557 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-17T12:04:03.557 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-base (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:03.565 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:03.565 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-ceph-argparse (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:03.579 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-cephfs. 2026-02-17T12:04:03.588 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../013-python3-cephfs_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:03.588 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-cephfs (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:03.604 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-17T12:04:03.612 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../014-python3-ceph-common_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:03.612 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-ceph-common (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:03.620 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-17T12:04:03.628 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-17T12:04:03.629 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-17T12:04:03.630 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-17T12:04:03.638 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-17T12:04:03.638 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T12:04:03.643 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-cheroot. 2026-02-17T12:04:03.651 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-17T12:04:03.652 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T12:04:03.654 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-prettytable. 2026-02-17T12:04:03.662 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2026-02-17T12:04:03.662 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-17T12:04:03.669 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-17T12:04:03.677 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-rbd. 2026-02-17T12:04:03.678 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-17T12:04:03.678 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-17T12:04:03.685 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../017-python3-rbd_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:03.686 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-rbd (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:03.692 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-17T12:04:03.701 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-17T12:04:03.701 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-17T12:04:03.702 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-17T12:04:03.710 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-17T12:04:03.710 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T12:04:03.716 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-17T12:04:03.724 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-17T12:04:03.724 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-17T12:04:03.728 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libreadline-dev:amd64. 2026-02-17T12:04:03.736 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2026-02-17T12:04:03.736 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T12:04:03.738 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-tempora. 2026-02-17T12:04:03.746 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2026-02-17T12:04:03.747 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-17T12:04:03.756 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2026-02-17T12:04:03.761 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-portend. 2026-02-17T12:04:03.764 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2026-02-17T12:04:03.764 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T12:04:03.770 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2026-02-17T12:04:03.770 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-17T12:04:03.782 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package lua5.1. 2026-02-17T12:04:03.783 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-17T12:04:03.790 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2026-02-17T12:04:03.790 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2026-02-17T12:04:03.790 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-17T12:04:03.791 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-17T12:04:03.805 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-17T12:04:03.809 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package lua-any. 2026-02-17T12:04:03.813 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-17T12:04:03.814 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-17T12:04:03.817 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2026-02-17T12:04:03.817 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking lua-any (27ubuntu1) ... 2026-02-17T12:04:03.831 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package zip. 2026-02-17T12:04:03.836 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-natsort. 2026-02-17T12:04:03.838 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2026-02-17T12:04:03.839 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking zip (3.0-12build2) ... 2026-02-17T12:04:03.844 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2026-02-17T12:04:03.844 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-17T12:04:03.855 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package unzip. 2026-02-17T12:04:03.860 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-logutils. 2026-02-17T12:04:03.862 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2026-02-17T12:04:03.863 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2026-02-17T12:04:03.868 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2026-02-17T12:04:03.869 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-logutils (0.3.3-8) ... 2026-02-17T12:04:03.879 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package luarocks. 2026-02-17T12:04:03.883 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-mako. 2026-02-17T12:04:03.887 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2026-02-17T12:04:03.888 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2026-02-17T12:04:03.891 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2026-02-17T12:04:03.892 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T12:04:03.909 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-simplegeneric. 2026-02-17T12:04:03.917 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2026-02-17T12:04:03.918 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2026-02-17T12:04:03.925 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package librgw2. 2026-02-17T12:04:03.931 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-singledispatch. 2026-02-17T12:04:03.933 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../026-librgw2_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:03.934 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking librgw2 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:03.939 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2026-02-17T12:04:03.940 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2026-02-17T12:04:03.953 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-webob. 2026-02-17T12:04:03.961 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-17T12:04:03.962 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T12:04:03.978 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-waitress. 2026-02-17T12:04:03.986 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1.1_all.deb ... 2026-02-17T12:04:03.988 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T12:04:04.003 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-tempita. 2026-02-17T12:04:04.004 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-rgw. 2026-02-17T12:04:04.011 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2026-02-17T12:04:04.011 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T12:04:04.012 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../027-python3-rgw_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:04.012 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-rgw (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.025 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-paste. 2026-02-17T12:04:04.027 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-17T12:04:04.033 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2026-02-17T12:04:04.034 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T12:04:04.036 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../028-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-17T12:04:04.036 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T12:04:04.050 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libradosstriper1. 2026-02-17T12:04:04.059 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../029-libradosstriper1_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:04.059 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libradosstriper1 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.062 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2026-02-17T12:04:04.070 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2026-02-17T12:04:04.070 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T12:04:04.077 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph-common. 2026-02-17T12:04:04.084 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-pastedeploy. 2026-02-17T12:04:04.085 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../030-ceph-common_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:04.085 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph-common (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.092 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2026-02-17T12:04:04.093 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2026-02-17T12:04:04.108 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-webtest. 2026-02-17T12:04:04.116 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2026-02-17T12:04:04.116 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-webtest (2.0.35-1) ... 2026-02-17T12:04:04.132 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-pecan. 2026-02-17T12:04:04.140 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2026-02-17T12:04:04.140 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T12:04:04.165 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-werkzeug. 2026-02-17T12:04:04.173 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.3_all.deb ... 2026-02-17T12:04:04.173 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T12:04:04.193 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-17T12:04:04.201 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:04.201 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-modules-core (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.229 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-17T12:04:04.237 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:04.237 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libsqlite3-mod-ceph (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.253 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr. 2026-02-17T12:04:04.260 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../057-ceph-mgr_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:04.261 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.284 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mon. 2026-02-17T12:04:04.289 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph-base. 2026-02-17T12:04:04.292 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../058-ceph-mon_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:04.292 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mon (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.297 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../031-ceph-base_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:04.302 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph-base (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.350 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-17T12:04:04.358 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../059-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-17T12:04:04.358 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T12:04:04.365 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-17T12:04:04.374 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-osd. 2026-02-17T12:04:04.374 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-17T12:04:04.374 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-17T12:04:04.382 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../060-ceph-osd_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:04.382 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-osd (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.389 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-cheroot. 2026-02-17T12:04:04.397 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-17T12:04:04.397 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T12:04:04.414 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-17T12:04:04.423 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-17T12:04:04.423 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-17T12:04:04.438 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-17T12:04:04.445 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-17T12:04:04.446 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-17T12:04:04.459 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-17T12:04:04.467 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-17T12:04:04.468 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-17T12:04:04.482 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-tempora. 2026-02-17T12:04:04.490 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2026-02-17T12:04:04.490 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-17T12:04:04.504 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-portend. 2026-02-17T12:04:04.512 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2026-02-17T12:04:04.513 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-17T12:04:04.527 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-17T12:04:04.535 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-17T12:04:04.535 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-17T12:04:04.537 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph. 2026-02-17T12:04:04.545 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../061-ceph_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:04.546 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.550 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-17T12:04:04.558 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-17T12:04:04.558 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-17T12:04:04.561 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-fuse. 2026-02-17T12:04:04.569 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../062-ceph-fuse_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:04.569 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-fuse (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.581 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-natsort. 2026-02-17T12:04:04.589 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2026-02-17T12:04:04.589 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-17T12:04:04.593 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mds. 2026-02-17T12:04:04.602 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../063-ceph-mds_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:04.602 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mds (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.606 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-logutils. 2026-02-17T12:04:04.614 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2026-02-17T12:04:04.614 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-logutils (0.3.3-8) ... 2026-02-17T12:04:04.629 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-mako. 2026-02-17T12:04:04.635 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package cephadm. 2026-02-17T12:04:04.637 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2026-02-17T12:04:04.637 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T12:04:04.643 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../064-cephadm_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:04.644 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking cephadm (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.656 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-simplegeneric. 2026-02-17T12:04:04.661 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-17T12:04:04.664 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2026-02-17T12:04:04.664 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2026-02-17T12:04:04.669 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T12:04:04.669 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T12:04:04.678 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-singledispatch. 2026-02-17T12:04:04.686 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2026-02-17T12:04:04.687 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2026-02-17T12:04:04.690 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-17T12:04:04.698 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../066-ceph-mgr-cephadm_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:04.699 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-cephadm (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.700 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-webob. 2026-02-17T12:04:04.708 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-17T12:04:04.708 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T12:04:04.718 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-17T12:04:04.725 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-waitress. 2026-02-17T12:04:04.726 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../067-python3-repoze.lru_0.7-2_all.deb ... 2026-02-17T12:04:04.727 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-17T12:04:04.733 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1.1_all.deb ... 2026-02-17T12:04:04.735 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T12:04:04.742 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-routes. 2026-02-17T12:04:04.750 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../068-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-17T12:04:04.751 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T12:04:04.751 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-tempita. 2026-02-17T12:04:04.759 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2026-02-17T12:04:04.760 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T12:04:04.770 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-17T12:04:04.774 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-paste. 2026-02-17T12:04:04.778 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../069-ceph-mgr-dashboard_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:04.778 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-dashboard (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.782 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2026-02-17T12:04:04.782 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T12:04:04.811 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2026-02-17T12:04:04.820 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2026-02-17T12:04:04.821 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T12:04:04.835 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-pastedeploy. 2026-02-17T12:04:04.843 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2026-02-17T12:04:04.843 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2026-02-17T12:04:04.859 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-webtest. 2026-02-17T12:04:04.867 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2026-02-17T12:04:04.868 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-webtest (2.0.35-1) ... 2026-02-17T12:04:04.883 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-pecan. 2026-02-17T12:04:04.891 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2026-02-17T12:04:04.891 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T12:04:04.916 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-werkzeug. 2026-02-17T12:04:04.924 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.3_all.deb ... 2026-02-17T12:04:04.924 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T12:04:04.943 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-17T12:04:04.951 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:04.951 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph-mgr-modules-core (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.979 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-17T12:04:04.983 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-17T12:04:04.987 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:04.987 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libsqlite3-mod-ceph (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:04.992 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-17T12:04:04.993 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T12:04:05.002 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph-mgr. 2026-02-17T12:04:05.010 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../057-ceph-mgr_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:05.010 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph-mgr (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:05.031 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-joblib. 2026-02-17T12:04:05.033 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph-mon. 2026-02-17T12:04:05.040 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../071-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-17T12:04:05.040 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T12:04:05.042 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../058-ceph-mon_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:05.042 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph-mon (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:05.067 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-17T12:04:05.075 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../072-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-17T12:04:05.075 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-17T12:04:05.090 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-sklearn. 2026-02-17T12:04:05.098 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../073-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-17T12:04:05.098 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T12:04:05.100 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-17T12:04:05.108 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../059-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-17T12:04:05.109 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T12:04:05.125 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph-osd. 2026-02-17T12:04:05.133 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../060-ceph-osd_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:05.134 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph-osd (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:05.181 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-17T12:04:05.190 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../074-ceph-mgr-diskprediction-local_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:05.190 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-diskprediction-local (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:05.294 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph. 2026-02-17T12:04:05.302 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../061-ceph_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:05.302 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:05.317 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph-fuse. 2026-02-17T12:04:05.325 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../062-ceph-fuse_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:05.326 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph-fuse (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:05.349 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph-mds. 2026-02-17T12:04:05.355 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-cachetools. 2026-02-17T12:04:05.358 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../063-ceph-mds_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:05.358 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph-mds (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:05.364 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../075-python3-cachetools_5.0.0-1_all.deb ... 2026-02-17T12:04:05.364 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-17T12:04:05.379 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-rsa. 2026-02-17T12:04:05.388 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../076-python3-rsa_4.8-1_all.deb ... 2026-02-17T12:04:05.388 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-17T12:04:05.391 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package cephadm. 2026-02-17T12:04:05.400 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../064-cephadm_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:05.400 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking cephadm (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:05.405 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-google-auth. 2026-02-17T12:04:05.414 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-3_all.deb ... 2026-02-17T12:04:05.414 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-17T12:04:05.417 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-17T12:04:05.425 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T12:04:05.425 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T12:04:05.432 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-17T12:04:05.440 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-17T12:04:05.441 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T12:04:05.446 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-17T12:04:05.454 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../066-ceph-mgr-cephadm_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:05.455 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph-mgr-cephadm (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:05.456 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-websocket. 2026-02-17T12:04:05.465 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../079-python3-websocket_1.2.3-1_all.deb ... 2026-02-17T12:04:05.465 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-17T12:04:05.474 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-17T12:04:05.482 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../067-python3-repoze.lru_0.7-2_all.deb ... 2026-02-17T12:04:05.483 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-17T12:04:05.483 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-17T12:04:05.490 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../080-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-17T12:04:05.491 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T12:04:05.498 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-routes. 2026-02-17T12:04:05.506 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../068-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-17T12:04:05.506 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T12:04:05.526 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-17T12:04:05.534 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../069-ceph-mgr-dashboard_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:05.535 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph-mgr-dashboard (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:05.581 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-17T12:04:05.590 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:05.591 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-k8sevents (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:05.605 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-17T12:04:05.613 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../082-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-17T12:04:05.620 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T12:04:05.636 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-17T12:04:05.644 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../083-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T12:04:05.645 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T12:04:05.659 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package jq. 2026-02-17T12:04:05.668 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../084-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T12:04:05.668 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-17T12:04:05.682 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package socat. 2026-02-17T12:04:05.691 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../085-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-17T12:04:05.691 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-17T12:04:05.711 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package xmlstarlet. 2026-02-17T12:04:05.719 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-17T12:04:05.719 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-17T12:04:05.736 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-17T12:04:05.745 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-17T12:04:05.745 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T12:04:05.755 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-test. 2026-02-17T12:04:05.763 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../087-ceph-test_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:05.764 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-test (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:05.784 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-joblib. 2026-02-17T12:04:05.792 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../071-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-17T12:04:05.792 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T12:04:05.819 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-17T12:04:05.827 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../072-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-17T12:04:05.827 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-17T12:04:05.843 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-sklearn. 2026-02-17T12:04:05.851 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../073-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-17T12:04:05.851 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T12:04:05.932 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-17T12:04:05.941 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../074-ceph-mgr-diskprediction-local_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:05.941 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph-mgr-diskprediction-local (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:06.106 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-cachetools. 2026-02-17T12:04:06.114 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../075-python3-cachetools_5.0.0-1_all.deb ... 2026-02-17T12:04:06.115 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-17T12:04:06.129 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-rsa. 2026-02-17T12:04:06.138 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../076-python3-rsa_4.8-1_all.deb ... 2026-02-17T12:04:06.138 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-17T12:04:06.155 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-google-auth. 2026-02-17T12:04:06.164 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-3_all.deb ... 2026-02-17T12:04:06.164 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-17T12:04:06.181 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-17T12:04:06.190 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-17T12:04:06.190 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T12:04:06.206 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-websocket. 2026-02-17T12:04:06.214 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../079-python3-websocket_1.2.3-1_all.deb ... 2026-02-17T12:04:06.215 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-17T12:04:06.232 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-17T12:04:06.233 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-volume. 2026-02-17T12:04:06.240 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../080-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-17T12:04:06.240 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T12:04:06.241 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../088-ceph-volume_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:06.242 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-volume (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:06.264 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-17T12:04:06.273 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../089-libcephfs-dev_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:06.273 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libcephfs-dev (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:06.289 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package lua-socket:amd64. 2026-02-17T12:04:06.298 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../090-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2026-02-17T12:04:06.298 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T12:04:06.319 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package lua-sec:amd64. 2026-02-17T12:04:06.327 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../091-lua-sec_1.0.2-1_amd64.deb ... 2026-02-17T12:04:06.328 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2026-02-17T12:04:06.335 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-17T12:04:06.344 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:06.345 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package nvme-cli. 2026-02-17T12:04:06.345 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph-mgr-k8sevents (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:06.353 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../092-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-17T12:04:06.353 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T12:04:06.358 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-17T12:04:06.367 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../082-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-17T12:04:06.374 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T12:04:06.384 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package pkg-config. 2026-02-17T12:04:06.389 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-17T12:04:06.392 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../093-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2026-02-17T12:04:06.393 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T12:04:06.397 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../083-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T12:04:06.397 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T12:04:06.409 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-17T12:04:06.413 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package jq. 2026-02-17T12:04:06.418 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../094-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T12:04:06.418 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T12:04:06.421 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../084-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T12:04:06.422 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-17T12:04:06.437 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package socat. 2026-02-17T12:04:06.445 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../085-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-17T12:04:06.445 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-17T12:04:06.447 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-17T12:04:06.456 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../095-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-17T12:04:06.456 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-17T12:04:06.464 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package xmlstarlet. 2026-02-17T12:04:06.471 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-pastescript. 2026-02-17T12:04:06.472 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-17T12:04:06.473 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-17T12:04:06.479 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../096-python3-pastescript_2.0.2-4_all.deb ... 2026-02-17T12:04:06.479 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2026-02-17T12:04:06.498 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-pluggy. 2026-02-17T12:04:06.506 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../097-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-17T12:04:06.506 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-17T12:04:06.510 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph-test. 2026-02-17T12:04:06.517 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../087-ceph-test_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:06.518 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph-test (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:06.522 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-psutil. 2026-02-17T12:04:06.530 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../098-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-17T12:04:06.530 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-17T12:04:06.549 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-py. 2026-02-17T12:04:06.557 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../099-python3-py_1.10.0-1_all.deb ... 2026-02-17T12:04:06.558 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-17T12:04:06.579 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-pygments. 2026-02-17T12:04:06.587 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../100-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-17T12:04:06.588 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T12:04:06.630 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-pyinotify. 2026-02-17T12:04:06.639 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.3_all.deb ... 2026-02-17T12:04:06.639 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2026-02-17T12:04:06.655 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-toml. 2026-02-17T12:04:06.664 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../102-python3-toml_0.10.2-1_all.deb ... 2026-02-17T12:04:06.664 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-17T12:04:06.678 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-pytest. 2026-02-17T12:04:06.687 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../103-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-17T12:04:06.687 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T12:04:06.708 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-simplejson. 2026-02-17T12:04:06.716 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../104-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-17T12:04:06.717 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-17T12:04:06.735 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-17T12:04:06.743 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../105-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-17T12:04:06.743 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-17T12:04:06.814 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package radosgw. 2026-02-17T12:04:06.823 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../106-radosgw_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:06.824 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking radosgw (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:06.973 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package rbd-fuse. 2026-02-17T12:04:06.982 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../107-rbd-fuse_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:06.982 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking rbd-fuse (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:06.983 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package ceph-volume. 2026-02-17T12:04:06.991 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../088-ceph-volume_19.2.3-675-g3c96dfb3-1jammy_all.deb ... 2026-02-17T12:04:06.991 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking ceph-volume (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:07.012 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-17T12:04:07.014 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-17T12:04:07.022 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../089-libcephfs-dev_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:07.022 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking libcephfs-dev (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:07.037 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package lua-socket:amd64. 2026-02-17T12:04:07.046 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../090-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2026-02-17T12:04:07.046 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T12:04:07.067 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package lua-sec:amd64. 2026-02-17T12:04:07.076 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../091-lua-sec_1.0.2-1_amd64.deb ... 2026-02-17T12:04:07.077 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2026-02-17T12:04:07.077 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T12:04:07.078 INFO:teuthology.orchestra.run.trial119.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T12:04:07.093 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package nvme-cli. 2026-02-17T12:04:07.102 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../092-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-17T12:04:07.102 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T12:04:07.133 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package pkg-config. 2026-02-17T12:04:07.141 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../093-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2026-02-17T12:04:07.142 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T12:04:07.148 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T12:04:07.158 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-17T12:04:07.166 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../094-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T12:04:07.166 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T12:04:07.196 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-17T12:04:07.205 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../095-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-17T12:04:07.205 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-17T12:04:07.220 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-pastescript. 2026-02-17T12:04:07.228 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../096-python3-pastescript_2.0.2-4_all.deb ... 2026-02-17T12:04:07.229 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2026-02-17T12:04:07.247 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-pluggy. 2026-02-17T12:04:07.255 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../097-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-17T12:04:07.256 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-17T12:04:07.271 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-psutil. 2026-02-17T12:04:07.279 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../098-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-17T12:04:07.280 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-17T12:04:07.298 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-py. 2026-02-17T12:04:07.306 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../099-python3-py_1.10.0-1_all.deb ... 2026-02-17T12:04:07.307 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-17T12:04:07.328 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-pygments. 2026-02-17T12:04:07.336 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../100-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-17T12:04:07.336 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T12:04:07.378 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-pyinotify. 2026-02-17T12:04:07.386 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.3_all.deb ... 2026-02-17T12:04:07.387 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2026-02-17T12:04:07.402 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-toml. 2026-02-17T12:04:07.410 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../102-python3-toml_0.10.2-1_all.deb ... 2026-02-17T12:04:07.411 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-17T12:04:07.421 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-17T12:04:07.426 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-pytest. 2026-02-17T12:04:07.434 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../103-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-17T12:04:07.435 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T12:04:07.456 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package python3-simplejson. 2026-02-17T12:04:07.465 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../104-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-17T12:04:07.465 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-17T12:04:07.483 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-17T12:04:07.491 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../105-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-17T12:04:07.492 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-17T12:04:07.557 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package radosgw. 2026-02-17T12:04:07.565 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../106-radosgw_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:07.566 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking radosgw (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:07.676 INFO:teuthology.orchestra.run.trial077.stdout:Selecting previously unselected package rbd-fuse. 2026-02-17T12:04:07.685 INFO:teuthology.orchestra.run.trial077.stdout:Preparing to unpack .../107-rbd-fuse_19.2.3-675-g3c96dfb3-1jammy_amd64.deb ... 2026-02-17T12:04:07.685 INFO:teuthology.orchestra.run.trial077.stdout:Unpacking rbd-fuse (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:07.713 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-17T12:04:07.781 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T12:04:07.782 INFO:teuthology.orchestra.run.trial077.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T12:04:07.788 INFO:teuthology.orchestra.run.trial119.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-17T12:04:07.798 INFO:teuthology.orchestra.run.trial119.stdout:Setting up cephadm (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:07.841 INFO:teuthology.orchestra.run.trial119.stdout:Adding system user cephadm....done 2026-02-17T12:04:07.851 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T12:04:07.855 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T12:04:07.923 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-17T12:04:07.997 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T12:04:07.998 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-17T12:04:08.070 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-17T12:04:08.134 INFO:teuthology.orchestra.run.trial119.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T12:04:08.135 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-17T12:04:08.135 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-17T12:04:08.233 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T12:04:08.357 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-17T12:04:08.432 INFO:teuthology.orchestra.run.trial119.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2026-02-17T12:04:08.442 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2026-02-17T12:04:08.518 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-17T12:04:08.521 INFO:teuthology.orchestra.run.trial077.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-17T12:04:08.531 INFO:teuthology.orchestra.run.trial077.stdout:Setting up cephadm (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:08.575 INFO:teuthology.orchestra.run.trial077.stdout:Adding system user cephadm....done 2026-02-17T12:04:08.586 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T12:04:08.591 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-ceph-argparse (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:08.656 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T12:04:08.656 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-17T12:04:08.657 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-17T12:04:08.657 INFO:teuthology.orchestra.run.trial119.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T12:04:08.658 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T12:04:08.659 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T12:04:08.660 INFO:teuthology.orchestra.run.trial119.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2026-02-17T12:04:08.678 INFO:teuthology.orchestra.run.trial119.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2026-02-17T12:04:08.680 INFO:teuthology.orchestra.run.trial119.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2026-02-17T12:04:08.681 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T12:04:08.682 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-17T12:04:08.729 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T12:04:08.729 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-17T12:04:08.802 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-17T12:04:08.804 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-17T12:04:08.877 INFO:teuthology.orchestra.run.trial077.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T12:04:08.878 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-17T12:04:08.883 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T12:04:08.959 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-17T12:04:08.976 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T12:04:09.049 INFO:teuthology.orchestra.run.trial119.stdout:Setting up zip (3.0-12build2) ... 2026-02-17T12:04:09.050 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T12:04:09.101 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-17T12:04:09.176 INFO:teuthology.orchestra.run.trial077.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2026-02-17T12:04:09.188 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2026-02-17T12:04:09.265 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-17T12:04:09.302 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T12:04:09.339 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-ceph-argparse (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:09.377 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T12:04:09.378 INFO:teuthology.orchestra.run.trial119.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-17T12:04:09.379 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T12:04:09.408 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T12:04:09.408 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-17T12:04:09.409 INFO:teuthology.orchestra.run.trial077.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T12:04:09.410 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T12:04:09.411 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T12:04:09.412 INFO:teuthology.orchestra.run.trial077.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2026-02-17T12:04:09.428 INFO:teuthology.orchestra.run.trial077.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2026-02-17T12:04:09.431 INFO:teuthology.orchestra.run.trial077.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2026-02-17T12:04:09.432 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T12:04:09.433 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-17T12:04:09.475 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T12:04:09.556 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-17T12:04:09.600 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T12:04:09.635 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T12:04:09.711 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-17T12:04:09.730 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T12:04:09.801 INFO:teuthology.orchestra.run.trial077.stdout:Setting up zip (3.0-12build2) ... 2026-02-17T12:04:09.802 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T12:04:09.810 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T12:04:09.915 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-17T12:04:09.989 INFO:teuthology.orchestra.run.trial119.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-17T12:04:09.990 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-ceph-common (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:10.055 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T12:04:10.073 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T12:04:10.130 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T12:04:10.130 INFO:teuthology.orchestra.run.trial077.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-17T12:04:10.131 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T12:04:10.225 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T12:04:10.348 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T12:04:10.478 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T12:04:10.559 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T12:04:10.579 INFO:teuthology.orchestra.run.trial119.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T12:04:10.602 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T12:04:10.606 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-17T12:04:10.667 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-17T12:04:10.682 INFO:teuthology.orchestra.run.trial119.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T12:04:10.683 INFO:teuthology.orchestra.run.trial119.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-17T12:04:10.684 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-17T12:04:10.739 INFO:teuthology.orchestra.run.trial077.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-17T12:04:10.740 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-ceph-common (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:10.760 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-17T12:04:10.820 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T12:04:10.833 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T12:04:10.834 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-17T12:04:10.911 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2026-02-17T12:04:10.986 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-logutils (0.3.3-8) ... 2026-02-17T12:04:11.061 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-17T12:04:11.135 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2026-02-17T12:04:11.209 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-17T12:04:11.287 INFO:teuthology.orchestra.run.trial119.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T12:04:11.288 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-17T12:04:11.322 INFO:teuthology.orchestra.run.trial077.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T12:04:11.343 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T12:04:11.347 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-17T12:04:11.371 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T12:04:11.372 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T12:04:11.423 INFO:teuthology.orchestra.run.trial077.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T12:04:11.424 INFO:teuthology.orchestra.run.trial077.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-17T12:04:11.424 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-17T12:04:11.449 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T12:04:11.500 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-17T12:04:11.528 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T12:04:11.573 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T12:04:11.574 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-17T12:04:11.614 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-17T12:04:11.656 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2026-02-17T12:04:11.687 INFO:teuthology.orchestra.run.trial119.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T12:04:11.688 INFO:teuthology.orchestra.run.trial119.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2026-02-17T12:04:11.689 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T12:04:11.689 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T12:04:11.731 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-logutils (0.3.3-8) ... 2026-02-17T12:04:11.806 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-17T12:04:11.829 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2026-02-17T12:04:11.884 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2026-02-17T12:04:11.895 INFO:teuthology.orchestra.run.trial119.stdout:Setting up lua-any (27ubuntu1) ... 2026-02-17T12:04:11.896 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-17T12:04:11.957 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-17T12:04:11.969 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T12:04:11.970 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-17T12:04:12.039 INFO:teuthology.orchestra.run.trial077.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T12:04:12.040 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-17T12:04:12.051 INFO:teuthology.orchestra.run.trial119.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-17T12:04:12.052 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-webtest (2.0.35-1) ... 2026-02-17T12:04:12.125 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T12:04:12.126 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T12:04:12.132 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-17T12:04:12.206 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T12:04:12.268 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-pastescript (2.0.2-4) ... 2026-02-17T12:04:12.285 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T12:04:12.360 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T12:04:12.370 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-17T12:04:12.443 INFO:teuthology.orchestra.run.trial077.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T12:04:12.444 INFO:teuthology.orchestra.run.trial077.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2026-02-17T12:04:12.445 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T12:04:12.446 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T12:04:12.477 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T12:04:12.478 INFO:teuthology.orchestra.run.trial119.stdout:Setting up librados2 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:12.479 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libsqlite3-mod-ceph (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:12.480 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T12:04:12.583 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2026-02-17T12:04:12.658 INFO:teuthology.orchestra.run.trial077.stdout:Setting up lua-any (27ubuntu1) ... 2026-02-17T12:04:12.659 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-17T12:04:12.735 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T12:04:12.736 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-17T12:04:12.819 INFO:teuthology.orchestra.run.trial077.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-17T12:04:12.820 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-webtest (2.0.35-1) ... 2026-02-17T12:04:12.902 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-17T12:04:13.010 INFO:teuthology.orchestra.run.trial119.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2026-02-17T12:04:13.021 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libcephfs2 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.021 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libradosstriper1 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.022 INFO:teuthology.orchestra.run.trial119.stdout:Setting up librbd1 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.023 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-modules-core (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.024 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-fuse (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.037 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-pastescript (2.0.2-4) ... 2026-02-17T12:04:13.093 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T12:04:13.094 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T12:04:13.130 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T12:04:13.242 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T12:04:13.243 INFO:teuthology.orchestra.run.trial077.stdout:Setting up librados2 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.244 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libsqlite3-mod-ceph (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.245 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T12:04:13.466 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libcephfs-dev (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.467 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-rados (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.468 INFO:teuthology.orchestra.run.trial119.stdout:Setting up librgw2 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.469 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-rbd (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.469 INFO:teuthology.orchestra.run.trial119.stdout:Setting up rbd-fuse (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.470 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-rgw (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.471 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-cephfs (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.472 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-common (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.500 INFO:teuthology.orchestra.run.trial119.stdout:Adding group ceph....done 2026-02-17T12:04:13.536 INFO:teuthology.orchestra.run.trial119.stdout:Adding system user ceph....done 2026-02-17T12:04:13.546 INFO:teuthology.orchestra.run.trial119.stdout:Setting system user ceph properties....done 2026-02-17T12:04:13.552 INFO:teuthology.orchestra.run.trial119.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-17T12:04:13.640 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-17T12:04:13.769 INFO:teuthology.orchestra.run.trial077.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2026-02-17T12:04:13.779 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libcephfs2 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.780 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libradosstriper1 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.781 INFO:teuthology.orchestra.run.trial077.stdout:Setting up librbd1 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.782 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph-mgr-modules-core (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.783 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph-fuse (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:13.850 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T12:04:13.850 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T12:04:13.908 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-17T12:04:14.248 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-test (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:14.248 INFO:teuthology.orchestra.run.trial119.stdout:Setting up radosgw (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:14.255 INFO:teuthology.orchestra.run.trial077.stdout:Setting up libcephfs-dev (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:14.256 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-rados (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:14.257 INFO:teuthology.orchestra.run.trial077.stdout:Setting up librgw2 (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:14.258 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-rbd (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:14.259 INFO:teuthology.orchestra.run.trial077.stdout:Setting up rbd-fuse (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:14.260 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-rgw (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:14.261 INFO:teuthology.orchestra.run.trial077.stdout:Setting up python3-cephfs (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:14.262 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph-common (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:14.290 INFO:teuthology.orchestra.run.trial077.stdout:Adding group ceph....done 2026-02-17T12:04:14.324 INFO:teuthology.orchestra.run.trial077.stdout:Adding system user ceph....done 2026-02-17T12:04:14.333 INFO:teuthology.orchestra.run.trial077.stdout:Setting system user ceph properties....done 2026-02-17T12:04:14.340 INFO:teuthology.orchestra.run.trial077.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-17T12:04:14.403 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-17T12:04:14.495 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T12:04:14.495 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T12:04:14.692 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-17T12:04:14.855 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-base (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:14.974 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-17T12:04:15.094 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph-test (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:15.094 INFO:teuthology.orchestra.run.trial077.stdout:Setting up radosgw (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:15.324 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mds (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:15.349 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T12:04:15.350 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T12:04:15.383 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T12:04:15.383 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T12:04:15.735 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:15.736 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph-base (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:15.810 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T12:04:15.810 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T12:04:15.853 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-17T12:04:16.171 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-osd (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:16.244 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph-mds (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:16.268 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T12:04:16.268 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T12:04:16.304 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T12:04:16.304 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T12:04:16.634 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-k8sevents (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:16.635 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-diskprediction-local (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:16.644 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mon (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:16.698 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph-mgr (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:16.717 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T12:04:16.717 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T12:04:16.773 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T12:04:16.773 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T12:04:17.090 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-cephadm (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:17.100 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:17.101 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-dashboard (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:17.111 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-volume (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:17.150 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph-osd (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:17.223 INFO:teuthology.orchestra.run.trial119.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2026-02-17T12:04:17.232 INFO:teuthology.orchestra.run.trial119.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-17T12:04:17.235 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T12:04:17.235 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T12:04:17.250 INFO:teuthology.orchestra.run.trial119.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-17T12:04:17.338 INFO:teuthology.orchestra.run.trial119.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-17T12:04:17.634 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph-mgr-k8sevents (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:17.635 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph-mgr-diskprediction-local (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:17.646 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph-mon (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:17.717 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T12:04:17.717 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T12:04:17.848 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:17.848 INFO:teuthology.orchestra.run.trial119.stdout:Running kernel seems to be up-to-date. 2026-02-17T12:04:17.848 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:17.848 INFO:teuthology.orchestra.run.trial119.stdout:The processor microcode seems to be up-to-date. 2026-02-17T12:04:17.848 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:17.848 INFO:teuthology.orchestra.run.trial119.stdout:No services need to be restarted. 2026-02-17T12:04:17.848 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:17.848 INFO:teuthology.orchestra.run.trial119.stdout:No containers need to be restarted. 2026-02-17T12:04:17.849 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:17.849 INFO:teuthology.orchestra.run.trial119.stdout:No user sessions are running outdated binaries. 2026-02-17T12:04:17.849 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:17.849 INFO:teuthology.orchestra.run.trial119.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T12:04:18.107 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph-mgr-cephadm (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:18.118 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:18.119 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph-mgr-dashboard (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:18.129 INFO:teuthology.orchestra.run.trial077.stdout:Setting up ceph-volume (19.2.3-675-g3c96dfb3-1jammy) ... 2026-02-17T12:04:18.239 INFO:teuthology.orchestra.run.trial077.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2026-02-17T12:04:18.246 INFO:teuthology.orchestra.run.trial077.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-17T12:04:18.263 INFO:teuthology.orchestra.run.trial077.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-17T12:04:18.349 INFO:teuthology.orchestra.run.trial077.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-17T12:04:18.491 INFO:teuthology.orchestra.run.trial119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-17T12:04:18.497 DEBUG:teuthology.parallel:result is None 2026-02-17T12:04:18.836 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:18.837 INFO:teuthology.orchestra.run.trial077.stdout:Running kernel seems to be up-to-date. 2026-02-17T12:04:18.837 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:18.837 INFO:teuthology.orchestra.run.trial077.stdout:The processor microcode seems to be up-to-date. 2026-02-17T12:04:18.837 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:18.837 INFO:teuthology.orchestra.run.trial077.stdout:No services need to be restarted. 2026-02-17T12:04:18.837 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:18.837 INFO:teuthology.orchestra.run.trial077.stdout:No containers need to be restarted. 2026-02-17T12:04:18.837 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:18.837 INFO:teuthology.orchestra.run.trial077.stdout:No user sessions are running outdated binaries. 2026-02-17T12:04:18.837 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:18.837 INFO:teuthology.orchestra.run.trial077.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T12:04:19.478 INFO:teuthology.orchestra.run.trial077.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-17T12:04:19.484 DEBUG:teuthology.parallel:result is None 2026-02-17T12:04:19.485 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:04:19.662 DEBUG:teuthology.orchestra.run.trial077:> dpkg-query -W -f '${Version}' ceph 2026-02-17T12:04:19.672 INFO:teuthology.orchestra.run.trial077.stdout:19.2.3-675-g3c96dfb3-1jammy 2026-02-17T12:04:19.673 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675-g3c96dfb3-1jammy 2026-02-17T12:04:19.673 INFO:teuthology.task.install:The correct ceph version 19.2.3-675-g3c96dfb3-1jammy is installed. 2026-02-17T12:04:19.676 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:04:19.828 DEBUG:teuthology.orchestra.run.trial119:> dpkg-query -W -f '${Version}' ceph 2026-02-17T12:04:19.838 INFO:teuthology.orchestra.run.trial119.stdout:19.2.3-675-g3c96dfb3-1jammy 2026-02-17T12:04:19.838 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675-g3c96dfb3-1jammy 2026-02-17T12:04:19.838 INFO:teuthology.task.install:The correct ceph version 19.2.3-675-g3c96dfb3-1jammy is installed. 2026-02-17T12:04:19.840 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T12:04:19.841 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:19.841 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T12:04:19.853 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:19.853 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T12:04:19.889 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T12:04:19.890 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:19.890 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T12:04:19.906 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T12:04:19.957 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:19.957 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T12:04:19.968 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T12:04:20.016 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T12:04:20.016 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:20.017 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T12:04:20.026 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T12:04:20.077 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:20.077 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T12:04:20.086 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T12:04:20.136 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T12:04:20.137 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:20.137 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T12:04:20.146 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T12:04:20.197 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:20.197 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T12:04:20.206 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T12:04:20.256 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T12:04:20.371 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T12:04:20.371 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod 777 /var/log/ceph 2026-02-17T12:04:20.373 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 777 /var/log/ceph 2026-02-17T12:04:20.380 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T12:04:20.380 DEBUG:teuthology.orchestra.run.trial077:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T12:04:20.422 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T12:04:20.431 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T12:04:20.431 DEBUG:teuthology.orchestra.run.trial077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T12:04:20.469 DEBUG:teuthology.orchestra.run.trial119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T12:04:20.494 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T12:04:20.494 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T12:04:20.494 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51399', 'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'description': 'rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51399', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_'], 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 4581, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'targets': {'trial077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMspI2MrX5oJyHSBUgV+0r2yzjxUohlEfiqJh+O9OzAhVKKpw05DgxPnDmg2gJ9SXG1q726AsQa6ColkLzeCk1g=', 'trial119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEfA1RRhHjOisJ3IYKSNTGUQKBIiulOwR4KPDdWGUThsfhfis232K+D66UoqqITo9F5rpk22HOfDUwwIPShJjIQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'thrash_delay': 1}}, {'exec': {'client.0': ['ceph_test_rados_delete_pools_parallel --debug_objecter 20 --debug_ms 1 --debug_rados 20 --debug_monc 20']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:10:36', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T12:04:20.495 DEBUG:teuthology.orchestra.run.trial077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T12:04:20.518 DEBUG:teuthology.orchestra.run.trial119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T12:04:20.532 DEBUG:teuthology.orchestra.run.trial077:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T12:04:20.562 DEBUG:teuthology.orchestra.run.trial119:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T12:04:20.580 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:20.580 DEBUG:teuthology.orchestra.run.trial077:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T12:04:20.613 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T12:04:20.613 DEBUG:teuthology.orchestra.run.trial077:> stat /dev/vg_nvme/lv_1 2026-02-17T12:04:20.661 INFO:teuthology.orchestra.run.trial077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T12:04:20.661 INFO:teuthology.orchestra.run.trial077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:04:20.662 INFO:teuthology.orchestra.run.trial077.stdout:Device: 5h/5d Inode: 904 Links: 1 2026-02-17T12:04:20.662 INFO:teuthology.orchestra.run.trial077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:04:20.662 INFO:teuthology.orchestra.run.trial077.stdout:Access: 2026-02-17 12:03:32.100676392 +0000 2026-02-17T12:04:20.662 INFO:teuthology.orchestra.run.trial077.stdout:Modify: 2026-02-17 12:03:31.944681368 +0000 2026-02-17T12:04:20.662 INFO:teuthology.orchestra.run.trial077.stdout:Change: 2026-02-17 12:03:31.944681368 +0000 2026-02-17T12:04:20.662 INFO:teuthology.orchestra.run.trial077.stdout: Birth: - 2026-02-17T12:04:20.662 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T12:04:20.712 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records in 2026-02-17T12:04:20.712 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records out 2026-02-17T12:04:20.712 INFO:teuthology.orchestra.run.trial077.stderr:512 bytes copied, 0.000193396 s, 2.6 MB/s 2026-02-17T12:04:20.713 DEBUG:teuthology.orchestra.run.trial077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T12:04:20.762 DEBUG:teuthology.orchestra.run.trial077:> stat /dev/vg_nvme/lv_2 2026-02-17T12:04:20.809 INFO:teuthology.orchestra.run.trial077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T12:04:20.809 INFO:teuthology.orchestra.run.trial077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:04:20.809 INFO:teuthology.orchestra.run.trial077.stdout:Device: 5h/5d Inode: 928 Links: 1 2026-02-17T12:04:20.809 INFO:teuthology.orchestra.run.trial077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:04:20.809 INFO:teuthology.orchestra.run.trial077.stdout:Access: 2026-02-17 12:03:32.436665675 +0000 2026-02-17T12:04:20.809 INFO:teuthology.orchestra.run.trial077.stdout:Modify: 2026-02-17 12:03:32.260671289 +0000 2026-02-17T12:04:20.809 INFO:teuthology.orchestra.run.trial077.stdout:Change: 2026-02-17 12:03:32.260671289 +0000 2026-02-17T12:04:20.810 INFO:teuthology.orchestra.run.trial077.stdout: Birth: - 2026-02-17T12:04:20.810 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T12:04:20.859 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records in 2026-02-17T12:04:20.860 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records out 2026-02-17T12:04:20.860 INFO:teuthology.orchestra.run.trial077.stderr:512 bytes copied, 0.000178278 s, 2.9 MB/s 2026-02-17T12:04:20.861 DEBUG:teuthology.orchestra.run.trial077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T12:04:20.910 DEBUG:teuthology.orchestra.run.trial077:> stat /dev/vg_nvme/lv_3 2026-02-17T12:04:20.956 INFO:teuthology.orchestra.run.trial077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T12:04:20.956 INFO:teuthology.orchestra.run.trial077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:04:20.957 INFO:teuthology.orchestra.run.trial077.stdout:Device: 5h/5d Inode: 952 Links: 1 2026-02-17T12:04:20.957 INFO:teuthology.orchestra.run.trial077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:04:20.957 INFO:teuthology.orchestra.run.trial077.stdout:Access: 2026-02-17 12:03:32.780654703 +0000 2026-02-17T12:04:20.957 INFO:teuthology.orchestra.run.trial077.stdout:Modify: 2026-02-17 12:03:32.600660443 +0000 2026-02-17T12:04:20.957 INFO:teuthology.orchestra.run.trial077.stdout:Change: 2026-02-17 12:03:32.600660443 +0000 2026-02-17T12:04:20.957 INFO:teuthology.orchestra.run.trial077.stdout: Birth: - 2026-02-17T12:04:20.958 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T12:04:21.003 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records in 2026-02-17T12:04:21.004 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records out 2026-02-17T12:04:21.004 INFO:teuthology.orchestra.run.trial077.stderr:512 bytes copied, 0.000184178 s, 2.8 MB/s 2026-02-17T12:04:21.005 DEBUG:teuthology.orchestra.run.trial077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T12:04:21.054 DEBUG:teuthology.orchestra.run.trial077:> stat /dev/vg_nvme/lv_4 2026-02-17T12:04:21.100 INFO:teuthology.orchestra.run.trial077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T12:04:21.101 INFO:teuthology.orchestra.run.trial077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:04:21.101 INFO:teuthology.orchestra.run.trial077.stdout:Device: 5h/5d Inode: 977 Links: 1 2026-02-17T12:04:21.101 INFO:teuthology.orchestra.run.trial077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:04:21.101 INFO:teuthology.orchestra.run.trial077.stdout:Access: 2026-02-17 12:03:33.132643473 +0000 2026-02-17T12:04:21.101 INFO:teuthology.orchestra.run.trial077.stdout:Modify: 2026-02-17 12:03:32.948649343 +0000 2026-02-17T12:04:21.101 INFO:teuthology.orchestra.run.trial077.stdout:Change: 2026-02-17 12:03:32.948649343 +0000 2026-02-17T12:04:21.101 INFO:teuthology.orchestra.run.trial077.stdout: Birth: - 2026-02-17T12:04:21.102 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T12:04:21.148 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records in 2026-02-17T12:04:21.148 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records out 2026-02-17T12:04:21.148 INFO:teuthology.orchestra.run.trial077.stderr:512 bytes copied, 0.000166566 s, 3.1 MB/s 2026-02-17T12:04:21.149 DEBUG:teuthology.orchestra.run.trial077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T12:04:21.198 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T12:04:21.198 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:21.199 DEBUG:teuthology.orchestra.run.trial119:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T12:04:21.204 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T12:04:21.204 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_1 2026-02-17T12:04:21.248 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T12:04:21.248 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:04:21.248 INFO:teuthology.orchestra.run.trial119.stdout:Device: 5h/5d Inode: 900 Links: 1 2026-02-17T12:04:21.249 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:04:21.249 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-17 12:03:32.097661563 +0000 2026-02-17T12:04:21.249 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-17 12:03:31.937666660 +0000 2026-02-17T12:04:21.249 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-17 12:03:31.937666660 +0000 2026-02-17T12:04:21.249 INFO:teuthology.orchestra.run.trial119.stdout: Birth: - 2026-02-17T12:04:21.249 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T12:04:21.299 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-17T12:04:21.299 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-17T12:04:21.299 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000177188 s, 2.9 MB/s 2026-02-17T12:04:21.301 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T12:04:21.350 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_2 2026-02-17T12:04:21.396 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T12:04:21.396 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:04:21.396 INFO:teuthology.orchestra.run.trial119.stdout:Device: 5h/5d Inode: 935 Links: 1 2026-02-17T12:04:21.396 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:04:21.396 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-17 12:03:32.253656593 +0000 2026-02-17T12:04:21.397 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-17 12:03:32.249656720 +0000 2026-02-17T12:04:21.397 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-17 12:03:32.249656720 +0000 2026-02-17T12:04:21.397 INFO:teuthology.orchestra.run.trial119.stdout: Birth: - 2026-02-17T12:04:21.397 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T12:04:21.447 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-17T12:04:21.447 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-17T12:04:21.447 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000163752 s, 3.1 MB/s 2026-02-17T12:04:21.449 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T12:04:21.497 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_3 2026-02-17T12:04:21.544 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T12:04:21.544 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:04:21.544 INFO:teuthology.orchestra.run.trial119.stdout:Device: 5h/5d Inode: 949 Links: 1 2026-02-17T12:04:21.544 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:04:21.544 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-17 12:03:32.769640155 +0000 2026-02-17T12:04:21.544 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-17 12:03:32.605645380 +0000 2026-02-17T12:04:21.544 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-17 12:03:32.605645380 +0000 2026-02-17T12:04:21.545 INFO:teuthology.orchestra.run.trial119.stdout: Birth: - 2026-02-17T12:04:21.545 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T12:04:21.595 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-17T12:04:21.595 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-17T12:04:21.595 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000174343 s, 2.9 MB/s 2026-02-17T12:04:21.596 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T12:04:21.645 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_4 2026-02-17T12:04:21.692 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T12:04:21.692 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:04:21.692 INFO:teuthology.orchestra.run.trial119.stdout:Device: 5h/5d Inode: 971 Links: 1 2026-02-17T12:04:21.692 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:04:21.692 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-17 12:03:33.141628302 +0000 2026-02-17T12:04:21.692 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-17 12:03:32.941634674 +0000 2026-02-17T12:04:21.693 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-17 12:03:32.941634674 +0000 2026-02-17T12:04:21.693 INFO:teuthology.orchestra.run.trial119.stdout: Birth: - 2026-02-17T12:04:21.693 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T12:04:21.742 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-17T12:04:21.742 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-17T12:04:21.742 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000174101 s, 2.9 MB/s 2026-02-17T12:04:21.743 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T12:04:21.789 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-17T12:04:21.789 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial119.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-17T12:04:21.789 INFO:tasks.ceph:Generating config... 2026-02-17T12:04:21.792 INFO:tasks.ceph:[client] debug monc = 20 2026-02-17T12:04:21.792 INFO:tasks.ceph:[client] debug ms = 1 2026-02-17T12:04:21.792 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-17T12:04:21.792 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-17T12:04:21.792 INFO:tasks.ceph:[global] ms bind msgr1 = False 2026-02-17T12:04:21.792 INFO:tasks.ceph:[global] ms bind msgr2 = True 2026-02-17T12:04:21.792 INFO:tasks.ceph:[global] ms inject delay max = 1 2026-02-17T12:04:21.792 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2026-02-17T12:04:21.793 INFO:tasks.ceph:[global] ms inject delay type = mon 2026-02-17T12:04:21.793 INFO:tasks.ceph:[global] ms inject internal delays = 0.002 2026-02-17T12:04:21.793 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2026-02-17T12:04:21.793 INFO:tasks.ceph:[global] ms type = async 2026-02-17T12:04:21.793 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T12:04:21.793 INFO:tasks.ceph:[mgr] debug monc = 10 2026-02-17T12:04:21.793 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T12:04:21.793 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T12:04:21.793 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T12:04:21.793 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T12:04:21.793 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2026-02-17T12:04:21.793 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-17T12:04:21.794 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-17T12:04:21.794 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-17T12:04:21.794 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2026-02-17T12:04:21.794 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2026-02-17T12:04:21.794 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T12:04:21.794 INFO:tasks.ceph:[mon] paxos min = 10 2026-02-17T12:04:21.794 INFO:tasks.ceph:[mon] paxos service trim min = 5 2026-02-17T12:04:21.794 INFO:tasks.ceph:[mon] paxos trim min = 10 2026-02-17T12:04:21.794 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T12:04:21.794 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2026-02-17T12:04:21.794 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-17T12:04:21.794 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T12:04:21.795 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T12:04:21.795 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-17T12:04:21.795 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-17T12:04:21.795 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T12:04:21.795 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T12:04:21.795 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-17T12:04:21.795 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T12:04:21.795 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T12:04:21.795 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T12:04:21.795 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T12:04:21.795 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T12:04:21.796 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T12:04:21.796 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T12:04:21.796 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T12:04:21.796 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T12:04:21.796 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T12:04:21.796 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T12:04:21.796 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T12:04:21.796 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T12:04:21.814 INFO:teuthology.orchestra.run.trial077.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T12:04:21.817 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T12:04:21.880 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T12:04:21.928 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.77'), ('mon.c', '[v2:10.20.193.77:3301,v1:10.20.193.77:6790]'), ('mon.b', '10.20.193.119')] 2026-02-17T12:04:21.928 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.77,[v2:10.20.193.77:3301,v1:10.20.193.77:6790],10.20.193.119', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug monc': 10}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2026-02-17T12:04:21.929 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:21.929 DEBUG:teuthology.orchestra.run.trial077:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T12:04:21.972 DEBUG:teuthology.orchestra.run.trial077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.77 --addv c '[v2:10.20.193.77:3301,v1:10.20.193.77:6790]' --add b 10.20.193.119 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:04:22.031 INFO:teuthology.orchestra.run.trial077.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:04:22.032 INFO:teuthology.orchestra.run.trial077.stdout:monmaptool: generated fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:22.032 INFO:teuthology.orchestra.run.trial077.stdout:setting min_mon_release = quincy 2026-02-17T12:04:22.032 INFO:teuthology.orchestra.run.trial077.stdout:epoch 0 2026-02-17T12:04:22.032 INFO:teuthology.orchestra.run.trial077.stdout:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:22.032 INFO:teuthology.orchestra.run.trial077.stdout:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:22.032 INFO:teuthology.orchestra.run.trial077.stdout:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:22.032 INFO:teuthology.orchestra.run.trial077.stdout:min_mon_release 17 (quincy) 2026-02-17T12:04:22.032 INFO:teuthology.orchestra.run.trial077.stdout:election_strategy: 1 2026-02-17T12:04:22.032 INFO:teuthology.orchestra.run.trial077.stdout:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:22.033 INFO:teuthology.orchestra.run.trial077.stdout:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:22.033 INFO:teuthology.orchestra.run.trial077.stdout:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:22.033 INFO:teuthology.orchestra.run.trial077.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-17T12:04:22.035 DEBUG:teuthology.orchestra.run.trial077:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T12:04:22.094 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 093d53f2-7cd0-4506-a27d-4c950e190615... 2026-02-17T12:04:22.095 DEBUG:teuthology.orchestra.run.trial077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T12:04:22.143 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T12:04:22.160 INFO:teuthology.orchestra.run.trial077.stdout:[global] 2026-02-17T12:04:22.160 INFO:teuthology.orchestra.run.trial077.stdout: chdir = "" 2026-02-17T12:04:22.161 INFO:teuthology.orchestra.run.trial077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T12:04:22.161 INFO:teuthology.orchestra.run.trial077.stdout: auth supported = cephx 2026-02-17T12:04:22.161 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.161 INFO:teuthology.orchestra.run.trial077.stdout: filestore xattr use omap = true 2026-02-17T12:04:22.161 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.161 INFO:teuthology.orchestra.run.trial077.stdout: mon clock drift allowed = 1.000 2026-02-17T12:04:22.161 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.161 INFO:teuthology.orchestra.run.trial077.stdout: osd crush chooseleaf type = 0 2026-02-17T12:04:22.161 INFO:teuthology.orchestra.run.trial077.stdout: auth debug = true 2026-02-17T12:04:22.161 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.161 INFO:teuthology.orchestra.run.trial077.stdout: ms die on old message = true 2026-02-17T12:04:22.162 INFO:teuthology.orchestra.run.trial077.stdout: ms die on bug = true 2026-02-17T12:04:22.162 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.162 INFO:teuthology.orchestra.run.trial077.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T12:04:22.162 INFO:teuthology.orchestra.run.trial077.stdout: mon pg warn max object skew = 0 2026-02-17T12:04:22.162 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.162 INFO:teuthology.orchestra.run.trial077.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T12:04:22.162 INFO:teuthology.orchestra.run.trial077.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T12:04:22.162 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.162 INFO:teuthology.orchestra.run.trial077.stdout: osd pool default size = 2 2026-02-17T12:04:22.162 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.162 INFO:teuthology.orchestra.run.trial077.stdout: mon osd allow primary affinity = true 2026-02-17T12:04:22.163 INFO:teuthology.orchestra.run.trial077.stdout: mon osd allow pg remap = true 2026-02-17T12:04:22.163 INFO:teuthology.orchestra.run.trial077.stdout: mon warn on legacy crush tunables = false 2026-02-17T12:04:22.163 INFO:teuthology.orchestra.run.trial077.stdout: mon warn on crush straw calc version zero = false 2026-02-17T12:04:22.163 INFO:teuthology.orchestra.run.trial077.stdout: mon warn on no sortbitwise = false 2026-02-17T12:04:22.163 INFO:teuthology.orchestra.run.trial077.stdout: mon warn on osd down out interval zero = false 2026-02-17T12:04:22.163 INFO:teuthology.orchestra.run.trial077.stdout: mon warn on too few osds = false 2026-02-17T12:04:22.163 INFO:teuthology.orchestra.run.trial077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T12:04:22.163 INFO:teuthology.orchestra.run.trial077.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T12:04:22.163 INFO:teuthology.orchestra.run.trial077.stdout: mon_allow_pool_size_one = true 2026-02-17T12:04:22.165 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.166 INFO:teuthology.orchestra.run.trial077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T12:04:22.166 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.166 INFO:teuthology.orchestra.run.trial077.stdout: osd default data pool replay window = 5 2026-02-17T12:04:22.166 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.166 INFO:teuthology.orchestra.run.trial077.stdout: mon allow pool delete = true 2026-02-17T12:04:22.166 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.166 INFO:teuthology.orchestra.run.trial077.stdout: mon cluster log file level = debug 2026-02-17T12:04:22.167 INFO:teuthology.orchestra.run.trial077.stdout: debug asserts on shutdown = true 2026-02-17T12:04:22.167 INFO:teuthology.orchestra.run.trial077.stdout: mon health detail to clog = false 2026-02-17T12:04:22.167 INFO:teuthology.orchestra.run.trial077.stdout: mon host = "10.20.193.77,[v2:10.20.193.77:3301,v1:10.20.193.77:6790],10.20.193.119" 2026-02-17T12:04:22.167 INFO:teuthology.orchestra.run.trial077.stdout: mon client directed command retry = 5 2026-02-17T12:04:22.167 INFO:teuthology.orchestra.run.trial077.stdout: mon election default strategy = 1 2026-02-17T12:04:22.167 INFO:teuthology.orchestra.run.trial077.stdout: ms bind msgr1 = False 2026-02-17T12:04:22.167 INFO:teuthology.orchestra.run.trial077.stdout: ms bind msgr2 = True 2026-02-17T12:04:22.167 INFO:teuthology.orchestra.run.trial077.stdout: ms inject delay max = 1 2026-02-17T12:04:22.167 INFO:teuthology.orchestra.run.trial077.stdout: ms inject delay probability = 0.005 2026-02-17T12:04:22.168 INFO:teuthology.orchestra.run.trial077.stdout: ms inject delay type = mon 2026-02-17T12:04:22.168 INFO:teuthology.orchestra.run.trial077.stdout: ms inject internal delays = 0.002 2026-02-17T12:04:22.168 INFO:teuthology.orchestra.run.trial077.stdout: ms inject socket failures = 2500 2026-02-17T12:04:22.168 INFO:teuthology.orchestra.run.trial077.stdout: ms type = async 2026-02-17T12:04:22.168 INFO:teuthology.orchestra.run.trial077.stdout: fsid = 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:22.168 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.168 INFO:teuthology.orchestra.run.trial077.stdout:[osd] 2026-02-17T12:04:22.168 INFO:teuthology.orchestra.run.trial077.stdout: osd journal size = 100 2026-02-17T12:04:22.168 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.168 INFO:teuthology.orchestra.run.trial077.stdout: osd scrub load threshold = 5.0 2026-02-17T12:04:22.168 INFO:teuthology.orchestra.run.trial077.stdout: osd scrub max interval = 600 2026-02-17T12:04:22.168 INFO:teuthology.orchestra.run.trial077.stdout: osd mclock profile = high_recovery_ops 2026-02-17T12:04:22.169 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.169 INFO:teuthology.orchestra.run.trial077.stdout: osd recover clone overlap = true 2026-02-17T12:04:22.169 INFO:teuthology.orchestra.run.trial077.stdout: osd recovery max chunk = 1048576 2026-02-17T12:04:22.169 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.169 INFO:teuthology.orchestra.run.trial077.stdout: osd debug shutdown = true 2026-02-17T12:04:22.169 INFO:teuthology.orchestra.run.trial077.stdout: osd debug op order = true 2026-02-17T12:04:22.169 INFO:teuthology.orchestra.run.trial077.stdout: osd debug verify stray on activate = true 2026-02-17T12:04:22.169 INFO:teuthology.orchestra.run.trial077.stdout: osd debug trim objects = true 2026-02-17T12:04:22.169 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.169 INFO:teuthology.orchestra.run.trial077.stdout: osd open classes on start = true 2026-02-17T12:04:22.169 INFO:teuthology.orchestra.run.trial077.stdout: osd debug pg log writeout = true 2026-02-17T12:04:22.169 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.170 INFO:teuthology.orchestra.run.trial077.stdout: osd deep scrub update digest min age = 30 2026-02-17T12:04:22.170 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.170 INFO:teuthology.orchestra.run.trial077.stdout: osd map max advance = 10 2026-02-17T12:04:22.170 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.170 INFO:teuthology.orchestra.run.trial077.stdout: journal zero on create = true 2026-02-17T12:04:22.170 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.170 INFO:teuthology.orchestra.run.trial077.stdout: filestore ondisk finisher threads = 3 2026-02-17T12:04:22.170 INFO:teuthology.orchestra.run.trial077.stdout: filestore apply finisher threads = 3 2026-02-17T12:04:22.170 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.170 INFO:teuthology.orchestra.run.trial077.stdout: bdev debug aio = true 2026-02-17T12:04:22.170 INFO:teuthology.orchestra.run.trial077.stdout: osd debug misdirected ops = true 2026-02-17T12:04:22.170 INFO:teuthology.orchestra.run.trial077.stdout: bluestore block size = 96636764160 2026-02-17T12:04:22.170 INFO:teuthology.orchestra.run.trial077.stdout: bluestore compression algorithm = zstd 2026-02-17T12:04:22.171 INFO:teuthology.orchestra.run.trial077.stdout: bluestore compression mode = aggressive 2026-02-17T12:04:22.171 INFO:teuthology.orchestra.run.trial077.stdout: bluestore fsck on mount = True 2026-02-17T12:04:22.171 INFO:teuthology.orchestra.run.trial077.stdout: bluestore zero block detection = True 2026-02-17T12:04:22.171 INFO:teuthology.orchestra.run.trial077.stdout: debug bluefs = 20 2026-02-17T12:04:22.171 INFO:teuthology.orchestra.run.trial077.stdout: debug bluestore = 20 2026-02-17T12:04:22.171 INFO:teuthology.orchestra.run.trial077.stdout: debug ms = 1 2026-02-17T12:04:22.171 INFO:teuthology.orchestra.run.trial077.stdout: debug osd = 20 2026-02-17T12:04:22.171 INFO:teuthology.orchestra.run.trial077.stdout: debug rocksdb = 10 2026-02-17T12:04:22.171 INFO:teuthology.orchestra.run.trial077.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T12:04:22.171 INFO:teuthology.orchestra.run.trial077.stdout: mon osd full ratio = 0.9 2026-02-17T12:04:22.171 INFO:teuthology.orchestra.run.trial077.stdout: mon osd nearfull ratio = 0.8 2026-02-17T12:04:22.171 INFO:teuthology.orchestra.run.trial077.stdout: osd debug verify cached snaps = True 2026-02-17T12:04:22.171 INFO:teuthology.orchestra.run.trial077.stdout: osd debug verify missing on start = True 2026-02-17T12:04:22.172 INFO:teuthology.orchestra.run.trial077.stdout: osd failsafe full ratio = 0.95 2026-02-17T12:04:22.172 INFO:teuthology.orchestra.run.trial077.stdout: osd mclock override recovery settings = True 2026-02-17T12:04:22.172 INFO:teuthology.orchestra.run.trial077.stdout: osd objectstore = bluestore 2026-02-17T12:04:22.172 INFO:teuthology.orchestra.run.trial077.stdout: osd op queue = debug_random 2026-02-17T12:04:22.172 INFO:teuthology.orchestra.run.trial077.stdout: osd op queue cut off = debug_random 2026-02-17T12:04:22.172 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.172 INFO:teuthology.orchestra.run.trial077.stdout:[mgr] 2026-02-17T12:04:22.172 INFO:teuthology.orchestra.run.trial077.stdout: debug ms = 1 2026-02-17T12:04:22.172 INFO:teuthology.orchestra.run.trial077.stdout: debug mgr = 20 2026-02-17T12:04:22.172 INFO:teuthology.orchestra.run.trial077.stdout: debug mon = 20 2026-02-17T12:04:22.172 INFO:teuthology.orchestra.run.trial077.stdout: debug auth = 20 2026-02-17T12:04:22.172 INFO:teuthology.orchestra.run.trial077.stdout: mon reweight min pgs per osd = 4 2026-02-17T12:04:22.173 INFO:teuthology.orchestra.run.trial077.stdout: mon reweight min bytes per osd = 10 2026-02-17T12:04:22.173 INFO:teuthology.orchestra.run.trial077.stdout: mgr/telemetry/nag = false 2026-02-17T12:04:22.173 INFO:teuthology.orchestra.run.trial077.stdout: debug monc = 10 2026-02-17T12:04:22.173 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.173 INFO:teuthology.orchestra.run.trial077.stdout:[mon] 2026-02-17T12:04:22.173 INFO:teuthology.orchestra.run.trial077.stdout: debug ms = 1 2026-02-17T12:04:22.173 INFO:teuthology.orchestra.run.trial077.stdout: debug mon = 20 2026-02-17T12:04:22.173 INFO:teuthology.orchestra.run.trial077.stdout: debug paxos = 20 2026-02-17T12:04:22.173 INFO:teuthology.orchestra.run.trial077.stdout: debug auth = 20 2026-02-17T12:04:22.173 INFO:teuthology.orchestra.run.trial077.stdout: mon data avail warn = 5 2026-02-17T12:04:22.173 INFO:teuthology.orchestra.run.trial077.stdout: mon mgr mkfs grace = 240 2026-02-17T12:04:22.173 INFO:teuthology.orchestra.run.trial077.stdout: mon reweight min pgs per osd = 4 2026-02-17T12:04:22.174 INFO:teuthology.orchestra.run.trial077.stdout: mon osd reporter subtree level = osd 2026-02-17T12:04:22.174 INFO:teuthology.orchestra.run.trial077.stdout: mon osd prime pg temp = true 2026-02-17T12:04:22.174 INFO:teuthology.orchestra.run.trial077.stdout: mon reweight min bytes per osd = 10 2026-02-17T12:04:22.174 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.174 INFO:teuthology.orchestra.run.trial077.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T12:04:22.174 INFO:teuthology.orchestra.run.trial077.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T12:04:22.174 INFO:teuthology.orchestra.run.trial077.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T12:04:22.174 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.174 INFO:teuthology.orchestra.run.trial077.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T12:04:22.174 INFO:teuthology.orchestra.run.trial077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T12:04:22.174 INFO:teuthology.orchestra.run.trial077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T12:04:22.174 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.174 INFO:teuthology.orchestra.run.trial077.stdout: # 1m isn't quite enough 2026-02-17T12:04:22.175 INFO:teuthology.orchestra.run.trial077.stdout: mon_down_mkfs_grace = 2m 2026-02-17T12:04:22.175 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.175 INFO:teuthology.orchestra.run.trial077.stdout: mon_warn_on_filestore_osds = false 2026-02-17T12:04:22.175 INFO:teuthology.orchestra.run.trial077.stdout: mon min osdmap epochs = 25 2026-02-17T12:04:22.175 INFO:teuthology.orchestra.run.trial077.stdout: mon osdmap full prune interval = 2 2026-02-17T12:04:22.175 INFO:teuthology.orchestra.run.trial077.stdout: mon osdmap full prune min = 15 2026-02-17T12:04:22.175 INFO:teuthology.orchestra.run.trial077.stdout: mon osdmap full prune txsize = 2 2026-02-17T12:04:22.175 INFO:teuthology.orchestra.run.trial077.stdout: mon scrub inject crc mismatch = 0.01 2026-02-17T12:04:22.175 INFO:teuthology.orchestra.run.trial077.stdout: mon scrub inject missing keys = 0.05 2026-02-17T12:04:22.175 INFO:teuthology.orchestra.run.trial077.stdout: mon scrub interval = 300 2026-02-17T12:04:22.175 INFO:teuthology.orchestra.run.trial077.stdout: paxos min = 10 2026-02-17T12:04:22.175 INFO:teuthology.orchestra.run.trial077.stdout: paxos service trim min = 5 2026-02-17T12:04:22.175 INFO:teuthology.orchestra.run.trial077.stdout: paxos trim min = 10 2026-02-17T12:04:22.176 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:22.176 INFO:teuthology.orchestra.run.trial077.stdout:[client] 2026-02-17T12:04:22.176 INFO:teuthology.orchestra.run.trial077.stdout: rgw cache enabled = true 2026-02-17T12:04:22.176 INFO:teuthology.orchestra.run.trial077.stdout: rgw enable ops log = true 2026-02-17T12:04:22.176 INFO:teuthology.orchestra.run.trial077.stdout: rgw enable usage log = true 2026-02-17T12:04:22.176 INFO:teuthology.orchestra.run.trial077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T12:04:22.176 INFO:teuthology.orchestra.run.trial077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T12:04:22.176 INFO:teuthology.orchestra.run.trial077.stdout: debug monc = 20 2026-02-17T12:04:22.176 INFO:teuthology.orchestra.run.trial077.stdout: debug ms = 1 2026-02-17T12:04:22.176 INFO:teuthology.orchestra.run.trial077.stdout:[mon.a] 2026-02-17T12:04:22.176 INFO:teuthology.orchestra.run.trial077.stdout:[mon.c] 2026-02-17T12:04:22.176 INFO:teuthology.orchestra.run.trial077.stdout:[mon.b] 2026-02-17T12:04:22.178 INFO:teuthology.orchestra.run.trial119.stdout:[global] 2026-02-17T12:04:22.179 INFO:teuthology.orchestra.run.trial119.stdout: chdir = "" 2026-02-17T12:04:22.179 INFO:teuthology.orchestra.run.trial119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T12:04:22.179 INFO:teuthology.orchestra.run.trial119.stdout: auth supported = cephx 2026-02-17T12:04:22.179 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.179 INFO:teuthology.orchestra.run.trial119.stdout: filestore xattr use omap = true 2026-02-17T12:04:22.179 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.179 INFO:teuthology.orchestra.run.trial119.stdout: mon clock drift allowed = 1.000 2026-02-17T12:04:22.179 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.179 INFO:teuthology.orchestra.run.trial119.stdout: osd crush chooseleaf type = 0 2026-02-17T12:04:22.179 INFO:teuthology.orchestra.run.trial119.stdout: auth debug = true 2026-02-17T12:04:22.179 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.180 INFO:teuthology.orchestra.run.trial119.stdout: ms die on old message = true 2026-02-17T12:04:22.180 INFO:teuthology.orchestra.run.trial119.stdout: ms die on bug = true 2026-02-17T12:04:22.180 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.180 INFO:teuthology.orchestra.run.trial119.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T12:04:22.180 INFO:teuthology.orchestra.run.trial119.stdout: mon pg warn max object skew = 0 2026-02-17T12:04:22.180 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.180 INFO:teuthology.orchestra.run.trial119.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T12:04:22.180 INFO:teuthology.orchestra.run.trial119.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T12:04:22.180 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.180 INFO:teuthology.orchestra.run.trial119.stdout: osd pool default size = 2 2026-02-17T12:04:22.180 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.180 INFO:teuthology.orchestra.run.trial119.stdout: mon osd allow primary affinity = true 2026-02-17T12:04:22.181 INFO:teuthology.orchestra.run.trial119.stdout: mon osd allow pg remap = true 2026-02-17T12:04:22.181 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on legacy crush tunables = false 2026-02-17T12:04:22.181 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on crush straw calc version zero = false 2026-02-17T12:04:22.181 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on no sortbitwise = false 2026-02-17T12:04:22.181 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on osd down out interval zero = false 2026-02-17T12:04:22.181 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on too few osds = false 2026-02-17T12:04:22.181 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T12:04:22.181 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T12:04:22.181 INFO:teuthology.orchestra.run.trial119.stdout: mon_allow_pool_size_one = true 2026-02-17T12:04:22.181 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.181 INFO:teuthology.orchestra.run.trial119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T12:04:22.181 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.181 INFO:teuthology.orchestra.run.trial119.stdout: osd default data pool replay window = 5 2026-02-17T12:04:22.182 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.182 INFO:teuthology.orchestra.run.trial119.stdout: mon allow pool delete = true 2026-02-17T12:04:22.182 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.182 INFO:teuthology.orchestra.run.trial119.stdout: mon cluster log file level = debug 2026-02-17T12:04:22.182 INFO:teuthology.orchestra.run.trial119.stdout: debug asserts on shutdown = true 2026-02-17T12:04:22.182 INFO:teuthology.orchestra.run.trial119.stdout: mon health detail to clog = false 2026-02-17T12:04:22.182 INFO:teuthology.orchestra.run.trial119.stdout: mon host = "10.20.193.77,[v2:10.20.193.77:3301,v1:10.20.193.77:6790],10.20.193.119" 2026-02-17T12:04:22.182 INFO:teuthology.orchestra.run.trial119.stdout: mon client directed command retry = 5 2026-02-17T12:04:22.182 INFO:teuthology.orchestra.run.trial119.stdout: mon election default strategy = 1 2026-02-17T12:04:22.182 INFO:teuthology.orchestra.run.trial119.stdout: ms bind msgr1 = False 2026-02-17T12:04:22.182 INFO:teuthology.orchestra.run.trial119.stdout: ms bind msgr2 = True 2026-02-17T12:04:22.182 INFO:teuthology.orchestra.run.trial119.stdout: ms inject delay max = 1 2026-02-17T12:04:22.182 INFO:teuthology.orchestra.run.trial119.stdout: ms inject delay probability = 0.005 2026-02-17T12:04:22.183 INFO:teuthology.orchestra.run.trial119.stdout: ms inject delay type = mon 2026-02-17T12:04:22.183 INFO:teuthology.orchestra.run.trial119.stdout: ms inject internal delays = 0.002 2026-02-17T12:04:22.183 INFO:teuthology.orchestra.run.trial119.stdout: ms inject socket failures = 2500 2026-02-17T12:04:22.183 INFO:teuthology.orchestra.run.trial119.stdout: ms type = async 2026-02-17T12:04:22.183 INFO:teuthology.orchestra.run.trial119.stdout: fsid = 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:22.183 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.183 INFO:teuthology.orchestra.run.trial119.stdout:[osd] 2026-02-17T12:04:22.183 INFO:teuthology.orchestra.run.trial119.stdout: osd journal size = 100 2026-02-17T12:04:22.183 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.183 INFO:teuthology.orchestra.run.trial119.stdout: osd scrub load threshold = 5.0 2026-02-17T12:04:22.183 INFO:teuthology.orchestra.run.trial119.stdout: osd scrub max interval = 600 2026-02-17T12:04:22.183 INFO:teuthology.orchestra.run.trial119.stdout: osd mclock profile = high_recovery_ops 2026-02-17T12:04:22.183 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.184 INFO:teuthology.orchestra.run.trial119.stdout: osd recover clone overlap = true 2026-02-17T12:04:22.184 INFO:teuthology.orchestra.run.trial119.stdout: osd recovery max chunk = 1048576 2026-02-17T12:04:22.184 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.184 INFO:teuthology.orchestra.run.trial119.stdout: osd debug shutdown = true 2026-02-17T12:04:22.184 INFO:teuthology.orchestra.run.trial119.stdout: osd debug op order = true 2026-02-17T12:04:22.184 INFO:teuthology.orchestra.run.trial119.stdout: osd debug verify stray on activate = true 2026-02-17T12:04:22.184 INFO:teuthology.orchestra.run.trial119.stdout: osd debug trim objects = true 2026-02-17T12:04:22.184 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.184 INFO:teuthology.orchestra.run.trial119.stdout: osd open classes on start = true 2026-02-17T12:04:22.184 INFO:teuthology.orchestra.run.trial119.stdout: osd debug pg log writeout = true 2026-02-17T12:04:22.184 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.184 INFO:teuthology.orchestra.run.trial119.stdout: osd deep scrub update digest min age = 30 2026-02-17T12:04:22.184 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.185 INFO:teuthology.orchestra.run.trial119.stdout: osd map max advance = 10 2026-02-17T12:04:22.185 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.185 INFO:teuthology.orchestra.run.trial119.stdout: journal zero on create = true 2026-02-17T12:04:22.185 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.185 INFO:teuthology.orchestra.run.trial119.stdout: filestore ondisk finisher threads = 3 2026-02-17T12:04:22.185 INFO:teuthology.orchestra.run.trial119.stdout: filestore apply finisher threads = 3 2026-02-17T12:04:22.185 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.185 INFO:teuthology.orchestra.run.trial119.stdout: bdev debug aio = true 2026-02-17T12:04:22.185 INFO:teuthology.orchestra.run.trial119.stdout: osd debug misdirected ops = true 2026-02-17T12:04:22.185 INFO:teuthology.orchestra.run.trial119.stdout: bluestore block size = 96636764160 2026-02-17T12:04:22.185 INFO:teuthology.orchestra.run.trial119.stdout: bluestore compression algorithm = zstd 2026-02-17T12:04:22.185 INFO:teuthology.orchestra.run.trial119.stdout: bluestore compression mode = aggressive 2026-02-17T12:04:22.185 INFO:teuthology.orchestra.run.trial119.stdout: bluestore fsck on mount = True 2026-02-17T12:04:22.186 INFO:teuthology.orchestra.run.trial119.stdout: bluestore zero block detection = True 2026-02-17T12:04:22.186 INFO:teuthology.orchestra.run.trial119.stdout: debug bluefs = 20 2026-02-17T12:04:22.186 INFO:teuthology.orchestra.run.trial119.stdout: debug bluestore = 20 2026-02-17T12:04:22.186 INFO:teuthology.orchestra.run.trial119.stdout: debug ms = 1 2026-02-17T12:04:22.186 INFO:teuthology.orchestra.run.trial119.stdout: debug osd = 20 2026-02-17T12:04:22.186 INFO:teuthology.orchestra.run.trial119.stdout: debug rocksdb = 10 2026-02-17T12:04:22.186 INFO:teuthology.orchestra.run.trial119.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T12:04:22.186 INFO:teuthology.orchestra.run.trial119.stdout: mon osd full ratio = 0.9 2026-02-17T12:04:22.186 INFO:teuthology.orchestra.run.trial119.stdout: mon osd nearfull ratio = 0.8 2026-02-17T12:04:22.186 INFO:teuthology.orchestra.run.trial119.stdout: osd debug verify cached snaps = True 2026-02-17T12:04:22.186 INFO:teuthology.orchestra.run.trial119.stdout: osd debug verify missing on start = True 2026-02-17T12:04:22.186 INFO:teuthology.orchestra.run.trial119.stdout: osd failsafe full ratio = 0.95 2026-02-17T12:04:22.186 INFO:teuthology.orchestra.run.trial119.stdout: osd mclock override recovery settings = True 2026-02-17T12:04:22.187 INFO:teuthology.orchestra.run.trial119.stdout: osd objectstore = bluestore 2026-02-17T12:04:22.187 INFO:teuthology.orchestra.run.trial119.stdout: osd op queue = debug_random 2026-02-17T12:04:22.187 INFO:teuthology.orchestra.run.trial119.stdout: osd op queue cut off = debug_random 2026-02-17T12:04:22.187 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.187 INFO:teuthology.orchestra.run.trial119.stdout:[mgr] 2026-02-17T12:04:22.187 INFO:teuthology.orchestra.run.trial119.stdout: debug ms = 1 2026-02-17T12:04:22.187 INFO:teuthology.orchestra.run.trial119.stdout: debug mgr = 20 2026-02-17T12:04:22.187 INFO:teuthology.orchestra.run.trial119.stdout: debug mon = 20 2026-02-17T12:04:22.187 INFO:teuthology.orchestra.run.trial119.stdout: debug auth = 20 2026-02-17T12:04:22.187 INFO:teuthology.orchestra.run.trial119.stdout: mon reweight min pgs per osd = 4 2026-02-17T12:04:22.187 INFO:teuthology.orchestra.run.trial119.stdout: mon reweight min bytes per osd = 10 2026-02-17T12:04:22.187 INFO:teuthology.orchestra.run.trial119.stdout: mgr/telemetry/nag = false 2026-02-17T12:04:22.188 INFO:teuthology.orchestra.run.trial119.stdout: debug monc = 10 2026-02-17T12:04:22.188 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.188 INFO:teuthology.orchestra.run.trial119.stdout:[mon] 2026-02-17T12:04:22.188 INFO:teuthology.orchestra.run.trial119.stdout: debug ms = 1 2026-02-17T12:04:22.188 INFO:teuthology.orchestra.run.trial119.stdout: debug mon = 20 2026-02-17T12:04:22.188 INFO:teuthology.orchestra.run.trial119.stdout: debug paxos = 20 2026-02-17T12:04:22.188 INFO:teuthology.orchestra.run.trial119.stdout: debug auth = 20 2026-02-17T12:04:22.188 INFO:teuthology.orchestra.run.trial119.stdout: mon data avail warn = 5 2026-02-17T12:04:22.188 INFO:teuthology.orchestra.run.trial119.stdout: mon mgr mkfs grace = 240 2026-02-17T12:04:22.188 INFO:teuthology.orchestra.run.trial119.stdout: mon reweight min pgs per osd = 4 2026-02-17T12:04:22.188 INFO:teuthology.orchestra.run.trial119.stdout: mon osd reporter subtree level = osd 2026-02-17T12:04:22.188 INFO:teuthology.orchestra.run.trial119.stdout: mon osd prime pg temp = true 2026-02-17T12:04:22.188 INFO:teuthology.orchestra.run.trial119.stdout: mon reweight min bytes per osd = 10 2026-02-17T12:04:22.189 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.189 INFO:teuthology.orchestra.run.trial119.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T12:04:22.189 INFO:teuthology.orchestra.run.trial119.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T12:04:22.189 INFO:teuthology.orchestra.run.trial119.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T12:04:22.189 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.189 INFO:teuthology.orchestra.run.trial119.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T12:04:22.189 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T12:04:22.189 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T12:04:22.189 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.189 INFO:teuthology.orchestra.run.trial119.stdout: # 1m isn't quite enough 2026-02-17T12:04:22.189 INFO:teuthology.orchestra.run.trial119.stdout: mon_down_mkfs_grace = 2m 2026-02-17T12:04:22.189 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.190 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_filestore_osds = false 2026-02-17T12:04:22.190 INFO:teuthology.orchestra.run.trial119.stdout: mon min osdmap epochs = 25 2026-02-17T12:04:22.190 INFO:teuthology.orchestra.run.trial119.stdout: mon osdmap full prune interval = 2 2026-02-17T12:04:22.190 INFO:teuthology.orchestra.run.trial119.stdout: mon osdmap full prune min = 15 2026-02-17T12:04:22.190 INFO:teuthology.orchestra.run.trial119.stdout: mon osdmap full prune txsize = 2 2026-02-17T12:04:22.190 INFO:teuthology.orchestra.run.trial119.stdout: mon scrub inject crc mismatch = 0.01 2026-02-17T12:04:22.190 INFO:teuthology.orchestra.run.trial119.stdout: mon scrub inject missing keys = 0.05 2026-02-17T12:04:22.190 INFO:teuthology.orchestra.run.trial119.stdout: mon scrub interval = 300 2026-02-17T12:04:22.190 INFO:teuthology.orchestra.run.trial119.stdout: paxos min = 10 2026-02-17T12:04:22.190 INFO:teuthology.orchestra.run.trial119.stdout: paxos service trim min = 5 2026-02-17T12:04:22.190 INFO:teuthology.orchestra.run.trial119.stdout: paxos trim min = 10 2026-02-17T12:04:22.190 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-17T12:04:22.190 INFO:teuthology.orchestra.run.trial119.stdout:[client] 2026-02-17T12:04:22.191 INFO:teuthology.orchestra.run.trial119.stdout: rgw cache enabled = true 2026-02-17T12:04:22.191 INFO:teuthology.orchestra.run.trial119.stdout: rgw enable ops log = true 2026-02-17T12:04:22.191 INFO:teuthology.orchestra.run.trial119.stdout: rgw enable usage log = true 2026-02-17T12:04:22.191 INFO:teuthology.orchestra.run.trial119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T12:04:22.191 INFO:teuthology.orchestra.run.trial119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T12:04:22.191 INFO:teuthology.orchestra.run.trial119.stdout: debug monc = 20 2026-02-17T12:04:22.191 INFO:teuthology.orchestra.run.trial119.stdout: debug ms = 1 2026-02-17T12:04:22.191 INFO:teuthology.orchestra.run.trial119.stdout:[mon.a] 2026-02-17T12:04:22.191 INFO:teuthology.orchestra.run.trial119.stdout:[mon.c] 2026-02-17T12:04:22.191 INFO:teuthology.orchestra.run.trial119.stdout:[mon.b] 2026-02-17T12:04:22.192 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T12:04:22.192 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T12:04:22.243 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T12:04:22.243 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:22.244 DEBUG:teuthology.orchestra.run.trial077:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T12:04:22.288 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:22.289 DEBUG:teuthology.orchestra.run.trial077:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T12:04:22.333 INFO:tasks.ceph:Sending monmap to node ubuntu@trial077.front.sepia.ceph.com 2026-02-17T12:04:22.334 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:22.334 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T12:04:22.334 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T12:04:22.391 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:22.391 DEBUG:teuthology.orchestra.run.trial077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:04:22.437 INFO:tasks.ceph:Sending monmap to node ubuntu@trial119.front.sepia.ceph.com 2026-02-17T12:04:22.437 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:22.438 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T12:04:22.438 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T12:04:22.453 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:22.453 DEBUG:teuthology.orchestra.run.trial119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:04:22.500 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T12:04:22.501 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T12:04:22.501 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T12:04:22.567 INFO:teuthology.orchestra.run.trial119.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T12:04:22.570 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T12:04:22.570 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T12:04:22.570 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T12:04:22.629 INFO:teuthology.orchestra.run.trial119.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T12:04:22.637 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T12:04:22.637 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial119.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-17T12:04:22.637 DEBUG:teuthology.orchestra.run.trial077:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T12:04:22.647 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T12:04:22.647 INFO:tasks.ceph:role: osd.0 2026-02-17T12:04:22.647 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial077.front.sepia.ceph.com 2026-02-17T12:04:22.647 DEBUG:teuthology.orchestra.run.trial077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T12:04:22.698 INFO:teuthology.orchestra.run.trial077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T12:04:22.698 INFO:teuthology.orchestra.run.trial077.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T12:04:22.699 INFO:teuthology.orchestra.run.trial077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T12:04:22.699 INFO:teuthology.orchestra.run.trial077.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T12:04:22.699 INFO:teuthology.orchestra.run.trial077.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T12:04:22.699 INFO:teuthology.orchestra.run.trial077.stdout: = sunit=0 swidth=0 blks 2026-02-17T12:04:22.699 INFO:teuthology.orchestra.run.trial077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T12:04:22.699 INFO:teuthology.orchestra.run.trial077.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T12:04:22.699 INFO:teuthology.orchestra.run.trial077.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T12:04:22.699 INFO:teuthology.orchestra.run.trial077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T12:04:23.264 INFO:teuthology.orchestra.run.trial077.stdout:Discarding blocks...Done. 2026-02-17T12:04:23.266 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial077.front.sepia.ceph.com -o noatime 2026-02-17T12:04:23.266 DEBUG:teuthology.orchestra.run.trial077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T12:04:23.325 DEBUG:teuthology.orchestra.run.trial077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T12:04:23.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:04:23.375 INFO:teuthology.orchestra.run.trial077.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T12:04:23.376 DEBUG:teuthology.orchestra.run.trial077:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T12:04:23.425 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T12:04:23.425 INFO:tasks.ceph:role: osd.1 2026-02-17T12:04:23.425 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial077.front.sepia.ceph.com 2026-02-17T12:04:23.426 DEBUG:teuthology.orchestra.run.trial077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T12:04:23.478 INFO:teuthology.orchestra.run.trial077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T12:04:23.479 INFO:teuthology.orchestra.run.trial077.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T12:04:23.479 INFO:teuthology.orchestra.run.trial077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T12:04:23.479 INFO:teuthology.orchestra.run.trial077.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T12:04:23.479 INFO:teuthology.orchestra.run.trial077.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T12:04:23.479 INFO:teuthology.orchestra.run.trial077.stdout: = sunit=0 swidth=0 blks 2026-02-17T12:04:23.479 INFO:teuthology.orchestra.run.trial077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T12:04:23.479 INFO:teuthology.orchestra.run.trial077.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T12:04:23.479 INFO:teuthology.orchestra.run.trial077.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T12:04:23.479 INFO:teuthology.orchestra.run.trial077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T12:04:24.051 INFO:teuthology.orchestra.run.trial077.stdout:Discarding blocks...Done. 2026-02-17T12:04:24.053 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial077.front.sepia.ceph.com -o noatime 2026-02-17T12:04:24.053 DEBUG:teuthology.orchestra.run.trial077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T12:04:24.109 DEBUG:teuthology.orchestra.run.trial077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T12:04:24.159 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:04:24.159 INFO:teuthology.orchestra.run.trial077.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T12:04:24.160 DEBUG:teuthology.orchestra.run.trial077:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T12:04:24.209 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T12:04:24.209 INFO:tasks.ceph:role: osd.2 2026-02-17T12:04:24.209 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial077.front.sepia.ceph.com 2026-02-17T12:04:24.209 DEBUG:teuthology.orchestra.run.trial077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T12:04:24.262 INFO:teuthology.orchestra.run.trial077.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T12:04:24.263 INFO:teuthology.orchestra.run.trial077.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T12:04:24.263 INFO:teuthology.orchestra.run.trial077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T12:04:24.263 INFO:teuthology.orchestra.run.trial077.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T12:04:24.263 INFO:teuthology.orchestra.run.trial077.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T12:04:24.263 INFO:teuthology.orchestra.run.trial077.stdout: = sunit=0 swidth=0 blks 2026-02-17T12:04:24.263 INFO:teuthology.orchestra.run.trial077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T12:04:24.263 INFO:teuthology.orchestra.run.trial077.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T12:04:24.263 INFO:teuthology.orchestra.run.trial077.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T12:04:24.264 INFO:teuthology.orchestra.run.trial077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T12:04:24.824 INFO:teuthology.orchestra.run.trial077.stdout:Discarding blocks...Done. 2026-02-17T12:04:24.825 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial077.front.sepia.ceph.com -o noatime 2026-02-17T12:04:24.825 DEBUG:teuthology.orchestra.run.trial077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T12:04:24.882 DEBUG:teuthology.orchestra.run.trial077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T12:04:24.930 INFO:teuthology.orchestra.run.trial077.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T12:04:24.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:04:24.932 DEBUG:teuthology.orchestra.run.trial077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:04:24.995 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:24.996+0000 7ff1418cf8c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T12:04:24.995 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:24.996+0000 7ff1418cf8c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T12:04:24.996 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:24.996+0000 7ff1418cf8c0 -1 bdev(0x5652dbe93800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T12:04:24.996 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:24.996+0000 7ff1418cf8c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T12:04:28.097 DEBUG:teuthology.orchestra.run.trial077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T12:04:28.146 DEBUG:teuthology.orchestra.run.trial077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:04:28.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:28.212+0000 7f9a880ee8c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T12:04:28.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:28.212+0000 7f9a880ee8c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T12:04:28.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:28.212+0000 7f9a880ee8c0 -1 bdev(0x56185fe45800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T12:04:28.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:28.212+0000 7f9a880ee8c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T12:04:31.341 DEBUG:teuthology.orchestra.run.trial077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T12:04:31.394 DEBUG:teuthology.orchestra.run.trial077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:04:31.458 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:31.460+0000 7fe4aa80e8c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T12:04:31.458 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:31.460+0000 7fe4aa80e8c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T12:04:31.458 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:31.460+0000 7fe4aa80e8c0 -1 bdev(0x560965c3b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T12:04:31.458 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:31.460+0000 7fe4aa80e8c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T12:04:34.592 DEBUG:teuthology.orchestra.run.trial077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T12:04:34.642 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-17T12:04:34.652 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-17T12:04:34.652 INFO:tasks.ceph:role: osd.3 2026-02-17T12:04:34.652 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial119.front.sepia.ceph.com 2026-02-17T12:04:34.652 DEBUG:teuthology.orchestra.run.trial119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T12:04:34.702 INFO:teuthology.orchestra.run.trial119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T12:04:34.702 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T12:04:34.702 INFO:teuthology.orchestra.run.trial119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T12:04:34.702 INFO:teuthology.orchestra.run.trial119.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T12:04:34.702 INFO:teuthology.orchestra.run.trial119.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T12:04:34.702 INFO:teuthology.orchestra.run.trial119.stdout: = sunit=0 swidth=0 blks 2026-02-17T12:04:34.702 INFO:teuthology.orchestra.run.trial119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T12:04:34.702 INFO:teuthology.orchestra.run.trial119.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T12:04:34.702 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T12:04:34.703 INFO:teuthology.orchestra.run.trial119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T12:04:35.280 INFO:teuthology.orchestra.run.trial119.stdout:Discarding blocks...Done. 2026-02-17T12:04:35.281 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial119.front.sepia.ceph.com -o noatime 2026-02-17T12:04:35.282 DEBUG:teuthology.orchestra.run.trial119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-17T12:04:35.337 DEBUG:teuthology.orchestra.run.trial119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-17T12:04:35.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:04:35.387 INFO:teuthology.orchestra.run.trial119.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T12:04:35.387 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-17T12:04:35.436 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-17T12:04:35.437 INFO:tasks.ceph:role: osd.4 2026-02-17T12:04:35.437 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial119.front.sepia.ceph.com 2026-02-17T12:04:35.437 DEBUG:teuthology.orchestra.run.trial119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T12:04:35.490 INFO:teuthology.orchestra.run.trial119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T12:04:35.490 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T12:04:35.490 INFO:teuthology.orchestra.run.trial119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T12:04:35.491 INFO:teuthology.orchestra.run.trial119.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T12:04:35.491 INFO:teuthology.orchestra.run.trial119.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T12:04:35.491 INFO:teuthology.orchestra.run.trial119.stdout: = sunit=0 swidth=0 blks 2026-02-17T12:04:35.491 INFO:teuthology.orchestra.run.trial119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T12:04:35.491 INFO:teuthology.orchestra.run.trial119.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T12:04:35.491 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T12:04:35.491 INFO:teuthology.orchestra.run.trial119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T12:04:36.055 INFO:teuthology.orchestra.run.trial119.stdout:Discarding blocks...Done. 2026-02-17T12:04:36.056 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial119.front.sepia.ceph.com -o noatime 2026-02-17T12:04:36.056 DEBUG:teuthology.orchestra.run.trial119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-17T12:04:36.112 DEBUG:teuthology.orchestra.run.trial119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-17T12:04:36.161 INFO:teuthology.orchestra.run.trial119.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T12:04:36.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:04:36.162 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-17T12:04:36.211 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-17T12:04:36.211 INFO:tasks.ceph:role: osd.5 2026-02-17T12:04:36.212 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial119.front.sepia.ceph.com 2026-02-17T12:04:36.212 DEBUG:teuthology.orchestra.run.trial119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T12:04:36.262 INFO:teuthology.orchestra.run.trial119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T12:04:36.262 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T12:04:36.262 INFO:teuthology.orchestra.run.trial119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T12:04:36.262 INFO:teuthology.orchestra.run.trial119.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T12:04:36.262 INFO:teuthology.orchestra.run.trial119.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T12:04:36.262 INFO:teuthology.orchestra.run.trial119.stdout: = sunit=0 swidth=0 blks 2026-02-17T12:04:36.262 INFO:teuthology.orchestra.run.trial119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T12:04:36.262 INFO:teuthology.orchestra.run.trial119.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T12:04:36.263 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T12:04:36.263 INFO:teuthology.orchestra.run.trial119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T12:04:36.834 INFO:teuthology.orchestra.run.trial119.stdout:Discarding blocks...Done. 2026-02-17T12:04:36.836 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial119.front.sepia.ceph.com -o noatime 2026-02-17T12:04:36.836 DEBUG:teuthology.orchestra.run.trial119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2026-02-17T12:04:36.889 DEBUG:teuthology.orchestra.run.trial119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-17T12:04:36.937 INFO:teuthology.orchestra.run.trial119.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T12:04:36.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:04:36.938 DEBUG:teuthology.orchestra.run.trial119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:04:37.002 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:37.000+0000 7fbda135d8c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-17T12:04:37.003 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:37.000+0000 7fbda135d8c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-17T12:04:37.003 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:37.000+0000 7fbda135d8c0 -1 bdev(0x55c9c3ced800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-17T12:04:37.003 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:37.000+0000 7fbda135d8c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-17T12:04:40.100 DEBUG:teuthology.orchestra.run.trial119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-17T12:04:40.148 DEBUG:teuthology.orchestra.run.trial119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:04:40.213 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:40.212+0000 7f52393ed8c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-17T12:04:40.214 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:40.212+0000 7f52393ed8c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-17T12:04:40.214 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:40.212+0000 7f52393ed8c0 -1 bdev(0x55ae22ddb800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-17T12:04:40.214 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:40.212+0000 7f52393ed8c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-17T12:04:43.321 DEBUG:teuthology.orchestra.run.trial119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-17T12:04:43.373 DEBUG:teuthology.orchestra.run.trial119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:04:43.437 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:43.436+0000 7feee15828c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-17T12:04:43.437 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:43.436+0000 7feee15828c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-17T12:04:43.438 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:43.436+0000 7feee15828c0 -1 bdev(0x559ee787f800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-17T12:04:43.438 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:43.436+0000 7feee15828c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-17T12:04:46.544 DEBUG:teuthology.orchestra.run.trial119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-17T12:04:46.593 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T12:04:46.594 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:46.594 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T12:04:46.605 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:46.606 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T12:04:46.658 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:46.659 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T12:04:46.710 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:46.711 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T12:04:46.722 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:46.722 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-17T12:04:46.773 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:46.774 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-17T12:04:46.824 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:46.824 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-17T12:04:46.873 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:46.873 DEBUG:teuthology.orchestra.run.trial119:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T12:04:46.921 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T12:04:46.921 DEBUG:teuthology.orchestra.run.trial077:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T12:04:46.923 DEBUG:teuthology.orchestra.run.trial119:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T12:04:46.967 INFO:teuthology.orchestra.run.trial077.stdout:[osd.0] 2026-02-17T12:04:46.967 INFO:teuthology.orchestra.run.trial077.stdout: key = AQBIWZRpMDOKOxAATjfk4wag7zBNgH00pnNKZQ== 2026-02-17T12:04:46.967 INFO:teuthology.orchestra.run.trial077.stdout:[osd.1] 2026-02-17T12:04:46.967 INFO:teuthology.orchestra.run.trial077.stdout: key = AQBMWZRpBoi+DBAAsKCJj9LVhurl09I1dEUPwg== 2026-02-17T12:04:46.967 INFO:teuthology.orchestra.run.trial077.stdout:[osd.2] 2026-02-17T12:04:46.968 INFO:teuthology.orchestra.run.trial077.stdout: key = AQBPWZRp1HyKGxAAs4hjBepBbkUsm+Py0miU2Q== 2026-02-17T12:04:46.968 INFO:teuthology.orchestra.run.trial077.stdout:[mgr.x] 2026-02-17T12:04:46.968 INFO:teuthology.orchestra.run.trial077.stdout: key = AQBGWZRpO33fIRAAvREkNc8DxoksdoRAsmqyqA== 2026-02-17T12:04:46.968 INFO:teuthology.orchestra.run.trial077.stdout:[osd.3] 2026-02-17T12:04:46.968 INFO:teuthology.orchestra.run.trial077.stdout: key = AQBVWZRpAtY6ABAAn9BKgdZUoja2AkJTS4+LAw== 2026-02-17T12:04:46.968 INFO:teuthology.orchestra.run.trial077.stdout:[osd.4] 2026-02-17T12:04:46.968 INFO:teuthology.orchestra.run.trial077.stdout: key = AQBYWZRpiL3DDBAANh2dsSnX4uNRLiAZRSGAyQ== 2026-02-17T12:04:46.968 INFO:teuthology.orchestra.run.trial077.stdout:[osd.5] 2026-02-17T12:04:46.968 INFO:teuthology.orchestra.run.trial077.stdout: key = AQBbWZRpbt4dGhAAlNNHCmoNq3qHAbgA8IZXDw== 2026-02-17T12:04:46.968 INFO:teuthology.orchestra.run.trial077.stdout:[client.0] 2026-02-17T12:04:46.968 INFO:teuthology.orchestra.run.trial077.stdout: key = AQBGWZRp+cKYJRAAQuCrBeqItlacN8SHK+0BoQ== 2026-02-17T12:04:46.971 INFO:teuthology.orchestra.run.trial119.stdout:[osd.0] 2026-02-17T12:04:46.971 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBIWZRpMDOKOxAATjfk4wag7zBNgH00pnNKZQ== 2026-02-17T12:04:46.971 INFO:teuthology.orchestra.run.trial119.stdout:[osd.1] 2026-02-17T12:04:46.971 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBMWZRpBoi+DBAAsKCJj9LVhurl09I1dEUPwg== 2026-02-17T12:04:46.971 INFO:teuthology.orchestra.run.trial119.stdout:[osd.2] 2026-02-17T12:04:46.972 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBPWZRp1HyKGxAAs4hjBepBbkUsm+Py0miU2Q== 2026-02-17T12:04:46.972 INFO:teuthology.orchestra.run.trial119.stdout:[mgr.x] 2026-02-17T12:04:46.972 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBGWZRpO33fIRAAvREkNc8DxoksdoRAsmqyqA== 2026-02-17T12:04:46.972 INFO:teuthology.orchestra.run.trial119.stdout:[osd.3] 2026-02-17T12:04:46.972 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBVWZRpAtY6ABAAn9BKgdZUoja2AkJTS4+LAw== 2026-02-17T12:04:46.972 INFO:teuthology.orchestra.run.trial119.stdout:[osd.4] 2026-02-17T12:04:46.972 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBYWZRpiL3DDBAANh2dsSnX4uNRLiAZRSGAyQ== 2026-02-17T12:04:46.972 INFO:teuthology.orchestra.run.trial119.stdout:[osd.5] 2026-02-17T12:04:46.972 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBbWZRpbt4dGhAAlNNHCmoNq3qHAbgA8IZXDw== 2026-02-17T12:04:46.972 INFO:teuthology.orchestra.run.trial119.stdout:[client.0] 2026-02-17T12:04:46.972 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBGWZRp+cKYJRAAQuCrBeqItlacN8SHK+0BoQ== 2026-02-17T12:04:46.974 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:04:47.015 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:04:47.038 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:04:47.079 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:04:47.101 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:04:47.142 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:04:47.164 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T12:04:47.203 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T12:04:47.224 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:04:47.263 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:04:47.284 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:04:47.323 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:04:47.344 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:04:47.383 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:04:47.408 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T12:04:47.447 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T12:04:47.473 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T12:04:47.474 DEBUG:teuthology.orchestra.run.trial077:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T12:04:47.522 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T12:04:47.592 DEBUG:teuthology.orchestra.run.trial077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T12:04:47.641 DEBUG:teuthology.orchestra.run.trial077:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-17T12:04:47.693 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T12:04:47.760 DEBUG:teuthology.orchestra.run.trial077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-17T12:04:47.809 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-17T12:04:47.819 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T12:04:47.885 DEBUG:teuthology.orchestra.run.trial119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-17T12:04:47.937 DEBUG:teuthology.orchestra.run.trial077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:04:47.939 DEBUG:teuthology.orchestra.run.trial119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:04:47.984 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T12:04:47.984 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T12:04:47.985 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T12:04:47.987 INFO:tasks.ceph.mon.a:Started 2026-02-17T12:04:47.987 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T12:04:47.987 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T12:04:47.989 INFO:tasks.ceph.mon.c:Started 2026-02-17T12:04:47.990 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T12:04:47.990 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T12:04:48.026 INFO:tasks.ceph.mon.b:Started 2026-02-17T12:04:48.026 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T12:04:48.026 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T12:04:48.027 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T12:04:48.028 INFO:tasks.ceph.mgr.x:Started 2026-02-17T12:04:48.029 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T12:04:48.029 DEBUG:teuthology.orchestra.run.trial077:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T12:04:48.087 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 10 monclient: get_monmap_and_config 2026-02-17T12:04:48.087 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 10 monclient: build_initial_monmap 2026-02-17T12:04:48.087 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 10 monclient: monmap: 2026-02-17T12:04:48.087 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:04:48.088 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:48.088 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:48.088538+0000 2026-02-17T12:04:48.088 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:48.088538+0000 2026-02-17T12:04:48.088 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:48.088 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:04:48.088 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:04:48.088 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:04:48.088 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:04:48.088 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:04:48.088 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:04:48.088 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:04:48.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 1 Processor -- start 2026-02-17T12:04:48.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 1 -- start start 2026-02-17T12:04:48.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 10 monclient: init 2026-02-17T12:04:48.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:48.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 10 monclient: _add_conns ranks=[3,1,0,4,2] 2026-02-17T12:04:48.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:48.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 10 monclient(hunting): picked mon.noname-a con 0x7fce940a89c0 addr v2:10.20.193.77:3300/0 2026-02-17T12:04:48.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fce941388c0 addr v1:10.20.193.119:6789/0 2026-02-17T12:04:48.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fce94138d10 addr v1:10.20.193.77:6789/0 2026-02-17T12:04:48.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce941391c0 con 0x7fce94138d10 2026-02-17T12:04:48.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce9409cf00 con 0x7fce941388c0 2026-02-17T12:04:48.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:48.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fce940aa530 con 0x7fce940a89c0 2026-02-17T12:04:48.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:48.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.083+0000 7fce9b863640 10 monclient(hunting): authenticate will time out at 539.763944s 2026-02-17T12:04:48.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.087+0000 7fce995d8640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.087+0000 7fce995d8640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:54302/0 (socket says 10.20.193.77:54302) 2026-02-17T12:04:48.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.087+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 learned_addr learned my addr 10.20.193.77:0/3182404360 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:04:48.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.087+0000 7fce995d8640 10 monclient(hunting): get_auth_request con 0x7fce940a89c0 auth_method 0 2026-02-17T12:04:48.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.087+0000 7fce995d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.087+0000 7fce995d8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.087+0000 7fce995d8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:48.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.087+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 msgr2=0x7fce94138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:48.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.087+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 msgr2=0x7fce94138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:48.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.087+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:48.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.087+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:48.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.087+0000 7fce99dd9640 1 -- 10.20.193.77:0/3182404360 >> v1:10.20.193.77:6789/0 conn(0x7fce94138d10 legacy=0x7fce940a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.087+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 >> v1:10.20.193.119:6789/0 conn(0x7fce941388c0 legacy=0x7fce940a8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:48.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.291+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.291 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.291+0000 7fce995d8640 10 monclient(hunting): get_auth_request con 0x7fce940a89c0 auth_method 0 2026-02-17T12:04:48.291 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.291+0000 7fce995d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.291 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.291+0000 7fce995d8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.291 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.291+0000 7fce995d8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:48.291 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.291+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 msgr2=0x7fce94138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:48.291 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.291+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 msgr2=0x7fce94138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:48.291 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.291+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:48.291 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.291+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:04:48.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.695+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.695+0000 7fce995d8640 10 monclient(hunting): get_auth_request con 0x7fce940a89c0 auth_method 0 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.695+0000 7fce995d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.695+0000 7fce995d8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.695+0000 7fce995d8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.695+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 msgr2=0x7fce94138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.695+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 msgr2=0x7fce94138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.695+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:48.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:48.695+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:04:49.498 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:49.499+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:49.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:49.499+0000 7fce995d8640 10 monclient(hunting): get_auth_request con 0x7fce940a89c0 auth_method 0 2026-02-17T12:04:49.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:49.499+0000 7fce995d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:49.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:49.499+0000 7fce995d8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:49.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:49.499+0000 7fce995d8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:49.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:49.499+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 msgr2=0x7fce94138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:49.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:49.499+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 msgr2=0x7fce94138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:49.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:49.499+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:49.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:49.499+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:04:51.088 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.083+0000 7fce82ffd640 10 monclient(hunting): tick 2026-02-17T12:04:51.088 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.083+0000 7fce82ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:04:51.088 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.083+0000 7fce82ffd640 1 monclient(hunting): continuing hunt 2026-02-17T12:04:51.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.083+0000 7fce82ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:04:51.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.083+0000 7fce82ffd640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 msgr2=0x7fce94138380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:51.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.083+0000 7fce82ffd640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.77:3300/0 conn(0x7fce940a89c0 0x7fce94138380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:51.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.083+0000 7fce82ffd640 1 -- 10.20.193.77:0/3182404360 >> v1:10.20.193.119:6789/0 conn(0x7fce941388c0 legacy=0x7fce940a8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:51.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce82ffd640 1 -- 10.20.193.77:0/3182404360 >> v1:10.20.193.77:6789/0 conn(0x7fce94138d10 legacy=0x7fce940a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:51.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce82ffd640 10 monclient: _add_conns ranks=[2,4] 2026-02-17T12:04:51.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce82ffd640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 0x7fce78005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:51.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce82ffd640 10 monclient(hunting): picked mon.noname-b con 0x7fce78003920 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:51.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce82ffd640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 0x7fce78008920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:51.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce82ffd640 10 monclient(hunting): picked mon.noname-c con 0x7fce78006480 addr v2:10.20.193.119:3300/0 2026-02-17T12:04:51.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce82ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:51.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce82ffd640 1 -- 10.20.193.77:0/3182404360 --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fce78008fb0 con 0x7fce78006480 2026-02-17T12:04:51.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce82ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:51.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce82ffd640 1 -- 10.20.193.77:0/3182404360 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fce78009160 con 0x7fce78003920 2026-02-17T12:04:51.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce82ffd640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:51.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 0x7fce78005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:51.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce995d8640 10 monclient(hunting): get_auth_request con 0x7fce78003920 auth_method 0 2026-02-17T12:04:51.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce995d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:51.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce995d8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:51.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce995d8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:51.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 msgr2=0x7fce78005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:51.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 msgr2=0x7fce78005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:51.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 0x7fce78005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:51.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 0x7fce78008920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:51.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 0x7fce78005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:51.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce98dd7640 10 monclient(hunting): get_auth_request con 0x7fce78006480 auth_method 0 2026-02-17T12:04:51.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce98dd7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:51.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce98dd7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:51.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce98dd7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:51.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 msgr2=0x7fce78008920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:04:51.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 msgr2=0x7fce78008920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:51.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 0x7fce78008920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:51.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.087+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 0x7fce78008920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:51.291 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 0x7fce78005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:51.291 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce995d8640 10 monclient(hunting): get_auth_request con 0x7fce78003920 auth_method 0 2026-02-17T12:04:51.291 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce995d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:51.291 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce995d8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:51.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce995d8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:51.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 msgr2=0x7fce78005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:04:51.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 msgr2=0x7fce78005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:51.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 0x7fce78005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:51.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 0x7fce78008920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:51.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 0x7fce78005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:04:51.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce98dd7640 10 monclient(hunting): get_auth_request con 0x7fce78006480 auth_method 0 2026-02-17T12:04:51.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce98dd7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:51.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce98dd7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:51.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce98dd7640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:51.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 msgr2=0x7fce78008920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:51.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 msgr2=0x7fce78008920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:51.293 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 0x7fce78008920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:51.293 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.291+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 0x7fce78008920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 0x7fce78005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce995d8640 10 monclient(hunting): get_auth_request con 0x7fce78003920 auth_method 0 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce995d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce995d8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce995d8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 msgr2=0x7fce78005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 msgr2=0x7fce78005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 0x7fce78005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 0x7fce78005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 0x7fce78008920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce98dd7640 10 monclient(hunting): get_auth_request con 0x7fce78006480 auth_method 0 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce98dd7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce98dd7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce98dd7640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 msgr2=0x7fce78008920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:51.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 msgr2=0x7fce78008920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:51.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 0x7fce78008920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:51.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:51.695+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 0x7fce78008920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:04:52.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 0x7fce78005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:52.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce995d8640 10 monclient(hunting): get_auth_request con 0x7fce78003920 auth_method 0 2026-02-17T12:04:52.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce995d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:52.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce995d8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:52.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce995d8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:52.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 msgr2=0x7fce78005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:04:52.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 msgr2=0x7fce78005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:52.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 0x7fce78005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:52.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 0x7fce78005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:04:52.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 0x7fce78008920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:52.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce98dd7640 10 monclient(hunting): get_auth_request con 0x7fce78006480 auth_method 0 2026-02-17T12:04:52.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce98dd7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:52.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce98dd7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:52.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce98dd7640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:52.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 msgr2=0x7fce78008920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:04:52.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 msgr2=0x7fce78008920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:52.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 0x7fce78008920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:52.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:52.499+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 0x7fce78008920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:04:54.088 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 10 monclient(hunting): tick 2026-02-17T12:04:54.088 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:04:54.088 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 1 monclient(hunting): continuing hunt 2026-02-17T12:04:54.088 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:04:54.088 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 msgr2=0x7fce78005d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:54.088 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78003920 0x7fce78005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.088 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 1 -- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 msgr2=0x7fce78008920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:54.088 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 1 --2- 10.20.193.77:0/3182404360 >> v2:10.20.193.119:3300/0 conn(0x7fce78006480 0x7fce78008920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.088 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce99dd9640 1 -- 10.20.193.77:0/3182404360 reap_dead start 2026-02-17T12:04:54.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-17T12:04:54.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fce78003d40 addr v1:10.20.193.119:6789/0 2026-02-17T12:04:54.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78007f80 0x7fce78008400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 10 monclient(hunting): picked mon.noname-b con 0x7fce78007f80 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:54.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fce780089d0 addr v1:10.20.193.77:6789/0 2026-02-17T12:04:54.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 1 -- 10.20.193.77:0/3182404360 --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce940aa700 con 0x7fce780089d0 2026-02-17T12:04:54.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 1 -- 10.20.193.77:0/3182404360 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce7800ff70 con 0x7fce78003d40 2026-02-17T12:04:54.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 1 -- 10.20.193.77:0/3182404360 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fce78008fb0 con 0x7fce78007f80 2026-02-17T12:04:54.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce82ffd640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:54.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78007f80 0x7fce78008400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce98dd7640 10 monclient(hunting): get_auth_request con 0x7fce78007f80 auth_method 0 2026-02-17T12:04:54.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce98dd7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce98dd7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce98dd7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78007f80 msgr2=0x7fce78008400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:04:54.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78007f80 msgr2=0x7fce78008400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:04:54.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78007f80 0x7fce78008400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:54.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78007f80 0x7fce78008400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:04:54.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce99dd9640 1 -- 10.20.193.77:0/3182404360 >> v1:10.20.193.77:6789/0 conn(0x7fce780089d0 legacy=0x7fce7800d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:54.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.087+0000 7fce995d8640 1 -- 10.20.193.77:0/3182404360 >> v1:10.20.193.119:6789/0 conn(0x7fce78003d40 legacy=0x7fce78006860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:54.272 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 -- 10.20.193.77:0/3182404360 <== mon.0 v1:10.20.193.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657393933 0 0) 0x7fce940aa700 con 0x7fce780089d0 2026-02-17T12:04:54.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient(hunting): _negotiate 2026-02-17T12:04:54.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient(hunting): my global_id is 4101 2026-02-17T12:04:54.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 -- 10.20.193.77:0/3182404360 --> v1:10.20.193.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce7c003630 con 0x7fce780089d0 2026-02-17T12:04:54.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 -- 10.20.193.77:0/3182404360 <== mon.0 v1:10.20.193.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2451935258 0 0) 0x7fce7c003630 con 0x7fce780089d0 2026-02-17T12:04:54.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78007f80 msgr2=0x7fce78008400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:04:54.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78007f80 0x7fce78008400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 -- 10.20.193.77:0/3182404360 >> v1:10.20.193.119:6789/0 conn(0x7fce78003d40 legacy=0x7fce78006860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient: _finish_hunting 0 2026-02-17T12:04:54.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:04:54.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:54.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.77:6789/0 2026-02-17T12:04:54.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 -- 10.20.193.77:0/3182404360 --> v1:10.20.193.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce78011260 con 0x7fce780089d0 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient: _finish_auth 0 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient: _check_auth_tickets 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 -- 10.20.193.77:0/3182404360 <== mon.0 v1:10.20.193.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3360639233 0 0) 0x7fce90003460 con 0x7fce780089d0 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient: dump: 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.274 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.275 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.275 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:04:54.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] but i'm connected to v1:10.20.193.77:6789/0, reconnecting 2026-02-17T12:04:54.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:54.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 -- 10.20.193.77:0/3182404360 >> v1:10.20.193.77:6789/0 conn(0x7fce780089d0 legacy=0x7fce7800d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:04:54.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce7c003af0 0x7fce7c003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient(hunting): picked mon.a con 0x7fce7c003af0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:04:54.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78007f80 0x7fce7c004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient(hunting): picked mon.c con 0x7fce78007f80 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:54.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce7c004ea0 0x7fce7c005320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient(hunting): picked mon.b con 0x7fce7c004ea0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:04:54.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 -- 10.20.193.77:0/3182404360 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce78008fb0 con 0x7fce7c003af0 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 -- 10.20.193.77:0/3182404360 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c00bd50 con 0x7fce7c004ea0 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 1 -- 10.20.193.77:0/3182404360 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fce7c00bf50 con 0x7fce78007f80 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce83fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce995d8640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce7c003af0 0x7fce7c003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78007f80 0x7fce7c004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce995d8640 10 monclient(hunting): get_auth_request con 0x7fce7c003af0 auth_method 0 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce995d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce995d8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce995d8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce98dd7640 10 monclient(hunting): get_auth_request con 0x7fce78007f80 auth_method 0 2026-02-17T12:04:54.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce98dd7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce98dd7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.267+0000 7fce98dd7640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce995d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce995d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce99dd9640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce7c004ea0 0x7fce7c005320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce995d8640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce99dd9640 10 monclient(hunting): get_auth_request con 0x7fce7c004ea0 auth_method 0 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce99dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce99dd9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce99dd9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 10 monclient(hunting): handle_auth_done global_id 4101 payload 293 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce7c004ea0 msgr2=0x7fce7c005320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:54.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce7c004ea0 0x7fce7c005320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce7c003af0 msgr2=0x7fce7c003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:54.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce7c003af0 0x7fce7c003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 10 monclient: _finish_hunting 0 2026-02-17T12:04:54.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 1 monclient: found mon.c 2026-02-17T12:04:54.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:54.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:04:54.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7c003630 con 0x7fce78007f80 2026-02-17T12:04:54.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 10 monclient: _finish_auth 0 2026-02-17T12:04:54.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 10 monclient: _check_auth_tickets 2026-02-17T12:04:54.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce98dd7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:54.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce9b863640 5 monclient: authenticate success, global_id 4101 2026-02-17T12:04:54.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.271+0000 7fce9b863640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:54.282 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce98dd7640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78007f80 msgr2=0x7fce7c004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:54.282 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce98dd7640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78007f80 0x7fce7c004910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fce88003340 tx=0x7fce8801d440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7df13d7dda3509da server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:54.282 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce83fff640 1 -- 10.20.193.77:0/3182404360 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce880b1070 con 0x7fce78007f80 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce83fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce83fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce83fff640 10 monclient: dump: 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce83fff640 1 -- 10.20.193.77:0/3182404360 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce880058d0 con 0x7fce78007f80 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce83fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:54.283 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce83fff640 1 -- 10.20.193.77:0/3182404360 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88002f90 con 0x7fce78007f80 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce83fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce83fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce83fff640 10 monclient: dump: 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 4 set_mon_vals no callback set 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient: shutdown 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 1 -- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78007f80 msgr2=0x7fce7c004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 1 --2- 10.20.193.77:0/3182404360 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce78007f80 0x7fce7c004910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fce88003340 tx=0x7fce8801d440 comp rx=0 tx=0).stop 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 1 -- 10.20.193.77:0/3182404360 reap_dead start 2026-02-17T12:04:54.284 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 1 -- 10.20.193.77:0/3182404360 shutdown_connections 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 1 -- 10.20.193.77:0/3182404360 >> 10.20.193.77:0/3182404360 conn(0x7fce94074c50 msgr2=0x7fce940aabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 1 -- 10.20.193.77:0/3182404360 shutdown_connections 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 1 -- 10.20.193.77:0/3182404360 wait complete. 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient: build_initial_monmap 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient: monmap: 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 1 Processor -- start 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 1 -- start start 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient: init 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:04:54.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce78007f80 0x7fce941d2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient(hunting): picked mon.noname-a con 0x7fce78007f80 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce94137940 0x7fce94137d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient(hunting): picked mon.noname-b con 0x7fce94137940 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce941cec40 0x7fce941cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient(hunting): picked mon.noname-c con 0x7fce941cec40 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce940a9730 con 0x7fce78007f80 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fce940a95b0 con 0x7fce94137940 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fce940a98b0 con 0x7fce941cec40 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce9b863640 10 monclient(hunting): authenticate will time out at 545.954576s 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce995d8640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce78007f80 0x7fce941d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce941cec40 0x7fce941cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce995d8640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce78007f80 0x7fce941d2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:48258/0 (socket says 10.20.193.77:48258) 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 10 monclient(hunting): get_auth_request con 0x7fce941cec40 auth_method 0 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce995d8640 1 -- 10.20.193.77:0/508148956 learned_addr learned my addr 10.20.193.77:0/508148956 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce995d8640 10 monclient(hunting): get_auth_request con 0x7fce78007f80 auth_method 0 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce995d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce995d8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce995d8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce98dd7640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce94137940 0x7fce94137d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce98dd7640 10 monclient(hunting): get_auth_request con 0x7fce94137940 auth_method 0 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce98dd7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce98dd7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce98dd7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce995d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce995d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce995d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce98dd7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce98dd7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce98dd7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 10 monclient(hunting): handle_auth_done global_id 4103 payload 824 2026-02-17T12:04:54.287 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 1 -- 10.20.193.77:0/508148956 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce94137940 msgr2=0x7fce94137d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce94137940 0x7fce94137d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 1 -- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce78007f80 msgr2=0x7fce941d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce78007f80 0x7fce941d2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 10 monclient: _finish_hunting 0 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 1 monclient: found mon.noname-c 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce99dd9640 1 -- 10.20.193.77:0/508148956 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce94126030 con 0x7fce941cec40 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.275+0000 7fce995d8640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce78007f80 0x7fce941d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce99dd9640 1 -- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce941cec40 msgr2=0x7fce941cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce99dd9640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce941cec40 0x7fce941cf0f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce941390f0 tx=0x7fce9000c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 1 -- 10.20.193.77:0/508148956 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9000cd20 con 0x7fce941cec40 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 10 monclient: dump: 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.288 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 10 monclient: _finish_auth 0 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 1 -- 10.20.193.77:0/508148956 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce90018070 con 0x7fce941cec40 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 1 -- 10.20.193.77:0/508148956 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce900072f0 con 0x7fce941cec40 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 10 monclient: dump: 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:04:54.289 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce837fe640 4 set_mon_vals no callback set 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce9b863640 5 monclient: authenticate success, global_id 4103 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce9b863640 10 monclient: _renew_subs 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce9b863640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce9b863640 1 -- 10.20.193.77:0/508148956 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce94126310 con 0x7fce941cec40 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce9b863640 10 monclient: _renew_subs 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce9b863640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce9b863640 1 -- 10.20.193.77:0/508148956 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fce94124da0 con 0x7fce941cec40 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 1 -- 10.20.193.77:0/508148956 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fce90007510 con 0x7fce941cec40 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 1 -- 10.20.193.77:0/508148956 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fce9001d9e0 con 0x7fce941cec40 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce9b863640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce9b863640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce9b863640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce9b863640 1 -- 10.20.193.77:0/508148956 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9413b7c0 con 0x7fce941cec40 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 1 -- 10.20.193.77:0/508148956 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fce9001d460 con 0x7fce941cec40 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:54.290 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.279+0000 7fce81ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:54.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce9b863640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T12:04:54.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce9b863640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T12:04:54.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce9b863640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:04:54.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce9b863640 1 -- 10.20.193.77:0/508148956 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fce9409e2d0 con 0x7fce941cec40 2026-02-17T12:04:54.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce99dd9640 1 -- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce941cec40 msgr2=0x7fce941cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:04:54.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce99dd9640 1 -- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce941cec40 msgr2=0x7fce941cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:04:54.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce99dd9640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce941cec40 0x7fce941cf0f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce941390f0 tx=0x7fce9000c4b0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:04:54.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce99dd9640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce941cec40 0x7fce941cf0f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce941390f0 tx=0x7fce9000c4b0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 10 monclient: ms_handle_reset current mon [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:54.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:54.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 1 -- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce941cec40 msgr2=0x7fce941cf0f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:04:54.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce941cec40 0x7fce941cf0f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:04:54.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce78007f80 0x7fce64007920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 10 monclient(hunting): picked mon.a con 0x7fce78007f80 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:04:54.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce94137940 0x7fce6400a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 10 monclient(hunting): picked mon.b con 0x7fce94137940 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:04:54.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce6400ab50 0x7fce6400cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 10 monclient(hunting): picked mon.c con 0x7fce6400ab50 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:54.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 1 -- 10.20.193.77:0/508148956 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce6400dae0 con 0x7fce78007f80 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 1 -- 10.20.193.77:0/508148956 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fce6400dc60 con 0x7fce94137940 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 1 -- 10.20.193.77:0/508148956 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fce6400de30 con 0x7fce6400ab50 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce78007f80 0x7fce64007920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 10 monclient(hunting): get_auth_request con 0x7fce78007f80 auth_method 0 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce99dd9640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce6400ab50 0x7fce6400cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce99dd9640 10 monclient(hunting): get_auth_request con 0x7fce6400ab50 auth_method 0 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce99dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce99dd9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce99dd9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 10 monclient(hunting): handle_auth_done global_id 4103 payload 293 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 1 -- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce6400ab50 msgr2=0x7fce6400cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce6400ab50 0x7fce6400cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 1 -- 10.20.193.77:0/508148956 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce94137940 msgr2=0x7fce6400a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce98dd7640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce94137940 0x7fce6400a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce94137940 0x7fce6400a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 10 monclient: _finish_hunting 0 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 1 monclient: found mon.a 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 1 -- 10.20.193.77:0/508148956 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7fce6400e030 con 0x7fce78007f80 2026-02-17T12:04:54.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T12:04:54.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:04:54.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 1 -- 10.20.193.77:0/508148956 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fce84003e40 con 0x7fce78007f80 2026-02-17T12:04:54.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 10 monclient: _finish_auth 0 2026-02-17T12:04:54.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 10 monclient: _check_auth_tickets 2026-02-17T12:04:54.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:54.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce98dd7640 10 monclient: get_auth_request con 0x7fce94137940 auth_method 0 2026-02-17T12:04:54.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce98dd7640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce94137940 0x7fce6400a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:04:54.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 1 -- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce78007f80 msgr2=0x7fce64007920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:54.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce995d8640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce78007f80 0x7fce64007920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fce84018640 tx=0x7fce90009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:54.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 1 -- 10.20.193.77:0/508148956 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84003b10 con 0x7fce78007f80 2026-02-17T12:04:54.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:54.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 10 monclient: dump: 2026-02-17T12:04:54.319 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:04:54.319 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.319 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.319 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.319 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.319 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:04:54.319 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.319 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.319 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.319 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 1 -- 10.20.193.77:0/508148956 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8402a070 con 0x7fce78007f80 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce81ffb640 1 -- 10.20.193.77:0/508148956 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fce840178f0 con 0x7fce78007f80 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.311+0000 7fce837fe640 4 set_mon_vals no callback set 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.315+0000 7fce81ffb640 1 -- 10.20.193.77:0/508148956 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fce84020050 con 0x7fce78007f80 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.315+0000 7fce81ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.315+0000 7fce81ffb640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:adjusted tunables profile to default 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.315+0000 7fce9b863640 10 monclient: shutdown 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.315+0000 7fce9b863640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.315+0000 7fce9b863640 1 -- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce78007f80 msgr2=0x7fce64007920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.315+0000 7fce9b863640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce78007f80 0x7fce64007920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fce84018640 tx=0x7fce90009040 comp rx=0 tx=0).stop 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.315+0000 7fce9b863640 1 -- 10.20.193.77:0/508148956 shutdown_connections 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.315+0000 7fce9b863640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fce6400ab50 0x7fce6400cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.315+0000 7fce9b863640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fce94137940 0x7fce6400a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.315+0000 7fce9b863640 1 --2- 10.20.193.77:0/508148956 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fce78007f80 0x7fce64007920 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.315+0000 7fce9b863640 1 -- 10.20.193.77:0/508148956 >> 10.20.193.77:0/508148956 conn(0x7fce94074c50 msgr2=0x7fce941c53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:54.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.315+0000 7fce9b863640 1 -- 10.20.193.77:0/508148956 shutdown_connections 2026-02-17T12:04:54.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:54.315+0000 7fce9b863640 1 -- 10.20.193.77:0/508148956 wait complete. 2026-02-17T12:04:54.325 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T12:04:54.326 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T12:04:54.326 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:54.326 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T12:04:54.335 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:54.335 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T12:04:54.361 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:54.359+0000 7f81fc7cf280 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T12:04:54.386 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:54.383+0000 7f81fc7cf280 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T12:04:54.387 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T12:04:54.388 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T12:04:54.423 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:54.419+0000 7f81fc7cf280 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T12:04:54.438 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:54.438 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-17T12:04:54.447 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:54.447 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-17T12:04:54.496 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-17T12:04:54.496 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-17T12:04:54.511 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:54.507+0000 7f81fc7cf280 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T12:04:54.518 DEBUG:teuthology.orchestra.run.trial119:> sudo ceph --cluster ceph osd new ad6780fd-cb0e-481f-8816-a32e3434b102 0 2026-02-17T12:04:54.591 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:54.587+0000 7f81fc7cf280 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:04:54.618 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 10 monclient: get_monmap_and_config 2026-02-17T12:04:54.618 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 10 monclient: build_initial_monmap 2026-02-17T12:04:54.618 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 10 monclient: monmap: 2026-02-17T12:04:54.618 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-17T12:04:54.618 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.618 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:54.618966+0000 2026-02-17T12:04:54.619 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:54.618966+0000 2026-02-17T12:04:54.619 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:54.619 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.619 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:04:54.619 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:04:54.619 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:04:54.619 INFO:teuthology.orchestra.run.trial119.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:04:54.619 INFO:teuthology.orchestra.run.trial119.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:04:54.619 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.628 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 1 Processor -- start 2026-02-17T12:04:54.628 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 1 -- start start 2026-02-17T12:04:54.628 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 10 monclient: init 2026-02-17T12:04:54.628 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:54.628 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 10 monclient: _add_conns ranks=[4,0,2,1,3] 2026-02-17T12:04:54.628 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f5dc00a89c0 0x7f5dc0138380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.628 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 10 monclient(hunting): picked mon.noname-c con 0x7f5dc00a89c0 addr v2:10.20.193.119:3300/0 2026-02-17T12:04:54.629 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5dc01388c0 addr v1:10.20.193.77:6789/0 2026-02-17T12:04:54.629 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5dc0138d10 0x7f5dc00a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.629 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 10 monclient(hunting): picked mon.noname-b con 0x7f5dc0138d10 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:54.629 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dc01391c0 con 0x7f5dc01388c0 2026-02-17T12:04:54.629 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.629 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc00aa530 con 0x7f5dc00a89c0 2026-02-17T12:04:54.629 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.629 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc009cf00 con 0x7f5dc0138d10 2026-02-17T12:04:54.629 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:54.629 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc648d640 10 monclient(hunting): authenticate will time out at 541.246512s 2026-02-17T12:04:54.630 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f5dc00a89c0 0x7f5dc0138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.630 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f5dc00a89c0 0x7f5dc0138380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.119:49916/0 (socket says 10.20.193.119:49916) 2026-02-17T12:04:54.630 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 1 -- 10.20.193.119:0/4036958651 learned_addr learned my addr 10.20.193.119:0/4036958651 (peer_addr_for_me v2:10.20.193.119:0/0) 2026-02-17T12:04:54.630 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 10 monclient(hunting): get_auth_request con 0x7f5dc00a89c0 auth_method 0 2026-02-17T12:04:54.630 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.630 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.630 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.630 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.630 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.630 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:54.631 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc4a03640 1 --2- 10.20.193.119:0/4036958651 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5dc0138d10 0x7f5dc00a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.631 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc4a03640 10 monclient(hunting): get_auth_request con 0x7f5dc0138d10 auth_method 0 2026-02-17T12:04:54.631 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc4a03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.631 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc4a03640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.631 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dc4a03640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.631 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 10 monclient(hunting): handle_auth_done global_id 4108 payload 274 2026-02-17T12:04:54.631 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 1 -- 10.20.193.119:0/4036958651 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5dc0138d10 msgr2=0x7f5dc00a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:54.631 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 1 --2- 10.20.193.119:0/4036958651 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5dc0138d10 0x7f5dc00a94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.631 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 1 -- 10.20.193.119:0/4036958651 >> v1:10.20.193.77:6789/0 conn(0x7f5dc01388c0 legacy=0x7f5dc00a8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:54.631 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 10 monclient: _finish_hunting 0 2026-02-17T12:04:54.631 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 1 monclient: found mon.noname-c 2026-02-17T12:04:54.631 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:54.632 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.632 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.615+0000 7f5dbffff640 1 -- 10.20.193.119:0/4036958651 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc00aa700 con 0x7f5dc00a89c0 2026-02-17T12:04:54.632 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbffff640 1 -- 10.20.193.119:0/4036958651 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5dc00a89c0 msgr2=0x7f5dc0138380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:54.632 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbffff640 1 --2- 10.20.193.119:0/4036958651 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5dc00a89c0 0x7f5dc0138380 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009970 tx=0x7f5dac01c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=957c58e7d772cff1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:54.632 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbeffd640 1 -- 10.20.193.119:0/4036958651 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac004030 con 0x7f5dc00a89c0 2026-02-17T12:04:54.632 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.632 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:54.632 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbeffd640 10 monclient: dump: 2026-02-17T12:04:54.632 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:54.632 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.632 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.632 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.633 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.633 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.633 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.633 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.633 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.633 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.633 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbeffd640 10 monclient: _finish_auth 0 2026-02-17T12:04:54.633 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbeffd640 10 monclient: _check_auth_tickets 2026-02-17T12:04:54.633 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:54.633 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbeffd640 1 -- 10.20.193.119:0/4036958651 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dac0041d0 con 0x7f5dc00a89c0 2026-02-17T12:04:54.633 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 5 monclient: authenticate success, global_id 4108 2026-02-17T12:04:54.633 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:54.634 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:54.634 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:54.634 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbeffd640 1 -- 10.20.193.119:0/4036958651 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0045a0 con 0x7f5dc00a89c0 2026-02-17T12:04:54.634 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.634 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 4 set_mon_vals no callback set 2026-02-17T12:04:54.634 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:54.634 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbeffd640 10 monclient: dump: 2026-02-17T12:04:54.634 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:54.634 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.634 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.634 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.634 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.634 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.635 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.635 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.635 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.635 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.635 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient: shutdown 2026-02-17T12:04:54.635 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:54.635 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 -- 10.20.193.119:0/4036958651 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5dc00a89c0 msgr2=0x7f5dc0138380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.635 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 --2- 10.20.193.119:0/4036958651 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5dc00a89c0 0x7f5dc0138380 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009970 tx=0x7f5dac01c4e0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.635 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 -- 10.20.193.119:0/4036958651 shutdown_connections 2026-02-17T12:04:54.635 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 --2- 10.20.193.119:0/4036958651 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5dc0138d10 0x7f5dc00a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.635 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 --2- 10.20.193.119:0/4036958651 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5dc00a89c0 0x7f5dc0138380 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.635 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 -- 10.20.193.119:0/4036958651 >> 10.20.193.119:0/4036958651 conn(0x7f5dc0074c50 msgr2=0x7f5dc00aabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:54.636 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 -- 10.20.193.119:0/4036958651 shutdown_connections 2026-02-17T12:04:54.636 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 -- 10.20.193.119:0/4036958651 wait complete. 2026-02-17T12:04:54.636 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient: build_initial_monmap 2026-02-17T12:04:54.636 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient: monmap: 2026-02-17T12:04:54.636 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-17T12:04:54.636 INFO:teuthology.orchestra.run.trial119.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:54.636 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 0.000000 2026-02-17T12:04:54.636 INFO:teuthology.orchestra.run.trial119.stderr:created 0.000000 2026-02-17T12:04:54.636 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:54.636 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.636 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:04:54.636 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:04:54.637 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:04:54.637 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.637 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 Processor -- start 2026-02-17T12:04:54.637 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 -- start start 2026-02-17T12:04:54.637 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient: init 2026-02-17T12:04:54.637 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:54.637 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:04:54.637 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5dc00a89c0 0x7f5dc01d24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.637 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient(hunting): picked mon.noname-c con 0x7f5dc00a89c0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:54.637 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5dc01388c0 0x7f5dc0137810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.637 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient(hunting): picked mon.noname-a con 0x7f5dc01388c0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:04:54.637 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5dc0138d10 0x7f5dc0137d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.638 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient(hunting): picked mon.noname-b con 0x7f5dc0138d10 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:04:54.638 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.638 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc009c360 con 0x7f5dc01388c0 2026-02-17T12:04:54.638 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.638 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc009c1e0 con 0x7f5dc0138d10 2026-02-17T12:04:54.638 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.638 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc0143010 con 0x7f5dc00a89c0 2026-02-17T12:04:54.638 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:54.638 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc648d640 10 monclient(hunting): authenticate will time out at 541.251439s 2026-02-17T12:04:54.638 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5dc0138d10 0x7f5dc0137d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.638 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5dc0138d10 0x7f5dc0137d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.119:49920/0 (socket says 10.20.193.119:49920) 2026-02-17T12:04:54.638 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 1 -- 10.20.193.119:0/187253146 learned_addr learned my addr 10.20.193.119:0/187253146 (peer_addr_for_me v2:10.20.193.119:0/0) 2026-02-17T12:04:54.638 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 10 monclient(hunting): get_auth_request con 0x7f5dc0138d10 auth_method 0 2026-02-17T12:04:54.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:54.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbffff640 1 --2- 10.20.193.119:0/187253146 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5dc00a89c0 0x7f5dc01d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbf7fe640 1 --2- 10.20.193.119:0/187253146 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5dc01388c0 0x7f5dc0137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbffff640 10 monclient(hunting): get_auth_request con 0x7f5dc00a89c0 auth_method 0 2026-02-17T12:04:54.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbf7fe640 10 monclient(hunting): get_auth_request con 0x7f5dc01388c0 auth_method 0 2026-02-17T12:04:54.640 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.640 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.640 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.640 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 10 monclient(hunting): handle_auth_done global_id 4111 payload 824 2026-02-17T12:04:54.640 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 1 -- 10.20.193.119:0/187253146 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5dc00a89c0 msgr2=0x7f5dc01d24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.640 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 1 --2- 10.20.193.119:0/187253146 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5dc00a89c0 0x7f5dc01d24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.640 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 1 -- 10.20.193.119:0/187253146 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5dc01388c0 msgr2=0x7f5dc0137810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.640 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 1 --2- 10.20.193.119:0/187253146 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5dc01388c0 0x7f5dc0137810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.640 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 10 monclient: _finish_hunting 0 2026-02-17T12:04:54.640 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 1 monclient: found mon.noname-b 2026-02-17T12:04:54.640 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:54.640 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.641 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.619+0000 7f5dc4a03640 1 -- 10.20.193.119:0/187253146 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc00a3ac0 con 0x7f5dc0138d10 2026-02-17T12:04:54.641 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dc4a03640 1 -- 10.20.193.119:0/187253146 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5dc0138d10 msgr2=0x7f5dc0137d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:54.641 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dc4a03640 1 --2- 10.20.193.119:0/187253146 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5dc0138d10 0x7f5dc0137d50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5db4007e40 tx=0x7f5db400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:54.641 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 1 -- 10.20.193.119:0/187253146 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4013790 con 0x7f5dc0138d10 2026-02-17T12:04:54.641 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.641 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:54.641 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 10 monclient: dump: 2026-02-17T12:04:54.641 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:54.641 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.641 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.641 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.641 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.642 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.642 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.642 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.642 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.642 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.642 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 10 monclient: _finish_auth 0 2026-02-17T12:04:54.642 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 10 monclient: _check_auth_tickets 2026-02-17T12:04:54.642 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:54.642 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 1 -- 10.20.193.119:0/187253146 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db4019070 con 0x7f5dc0138d10 2026-02-17T12:04:54.642 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:54.642 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 1 -- 10.20.193.119:0/187253146 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4013b90 con 0x7f5dc0138d10 2026-02-17T12:04:54.642 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.643 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:54.643 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbe7fc640 4 set_mon_vals no callback set 2026-02-17T12:04:54.643 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 10 monclient: dump: 2026-02-17T12:04:54.643 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:54.643 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.643 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.643 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.643 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.643 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.643 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.643 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.643 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.643 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.644 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dc648d640 5 monclient: authenticate success, global_id 4111 2026-02-17T12:04:54.644 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dc648d640 10 monclient: _renew_subs 2026-02-17T12:04:54.644 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dc648d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.644 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dc648d640 1 -- 10.20.193.119:0/187253146 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc00a7f50 con 0x7f5dc0138d10 2026-02-17T12:04:54.644 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dc648d640 10 monclient: _renew_subs 2026-02-17T12:04:54.644 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dc648d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.644 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dc648d640 1 -- 10.20.193.119:0/187253146 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc0121ec0 con 0x7f5dc0138d10 2026-02-17T12:04:54.644 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 1 -- 10.20.193.119:0/187253146 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f5db401e460 con 0x7f5dc0138d10 2026-02-17T12:04:54.644 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dbcff9640 1 -- 10.20.193.119:0/187253146 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f5db4014540 con 0x7f5dc0138d10 2026-02-17T12:04:54.644 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dc648d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:54.644 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dc648d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:54.644 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dc648d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.645 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.623+0000 7f5dc648d640 1 -- 10.20.193.119:0/187253146 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc0138380 con 0x7f5dc0138d10 2026-02-17T12:04:54.645 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:54.627+0000 7f81fc7cf280 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T12:04:54.646 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.627+0000 7f5dbcff9640 1 -- 10.20.193.119:0/187253146 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f5db401e910 con 0x7f5dc0138d10 2026-02-17T12:04:54.646 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.627+0000 7f5dbcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:54.646 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.627+0000 7f5dbcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:54.661 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "ad6780fd-cb0e-481f-8816-a32e3434b102", "id": 0}] 2026-02-17T12:04:54.661 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "ad6780fd-cb0e-481f-8816-a32e3434b102", "id": 0}] 2026-02-17T12:04:54.661 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.661 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 1 -- 10.20.193.119:0/187253146 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ad6780fd-cb0e-481f-8816-a32e3434b102", "id": 0} v 0) -- 0x7f5dc00008e0 con 0x7f5dc0138d10 2026-02-17T12:04:54.664 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dbcff9640 1 -- 10.20.193.119:0/187253146 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad6780fd-cb0e-481f-8816-a32e3434b102", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f5db401eaf0 con 0x7f5dc0138d10 2026-02-17T12:04:54.664 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dbcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "ad6780fd-cb0e-481f-8816-a32e3434b102", "id": 0}] 2026-02-17T12:04:54.664 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dbcff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:54.664 INFO:teuthology.orchestra.run.trial119.stdout:0 2026-02-17T12:04:54.664 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 10 monclient: shutdown 2026-02-17T12:04:54.664 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:54.664 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 1 -- 10.20.193.119:0/187253146 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5dc0138d10 msgr2=0x7f5dc0137d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.664 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 1 --2- 10.20.193.119:0/187253146 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5dc0138d10 0x7f5dc0137d50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5db4007e40 tx=0x7f5db400e4b0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.664 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 1 -- 10.20.193.119:0/187253146 shutdown_connections 2026-02-17T12:04:54.664 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 1 --2- 10.20.193.119:0/187253146 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5dc0138d10 0x7f5dc0137d50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.664 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 1 --2- 10.20.193.119:0/187253146 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5dc01388c0 0x7f5dc0137810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.664 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 1 --2- 10.20.193.119:0/187253146 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5dc00a89c0 0x7f5dc01d24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.665 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 1 -- 10.20.193.119:0/187253146 >> 10.20.193.119:0/187253146 conn(0x7f5dc0074c50 msgr2=0x7f5dc013fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:54.665 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 1 -- 10.20.193.119:0/187253146 shutdown_connections 2026-02-17T12:04:54.665 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.659+0000 7f5dc648d640 1 -- 10.20.193.119:0/187253146 wait complete. 2026-02-17T12:04:54.673 DEBUG:teuthology.orchestra.run.trial119:> sudo ceph --cluster ceph osd new a82a493e-88de-4b65-ab23-41b52ffb6b61 1 2026-02-17T12:04:54.704 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:54.699+0000 7f81fc7cf280 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T12:04:54.761 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 10 monclient: get_monmap_and_config 2026-02-17T12:04:54.761 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 10 monclient: build_initial_monmap 2026-02-17T12:04:54.762 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 10 monclient: monmap: 2026-02-17T12:04:54.762 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-17T12:04:54.762 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.762 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:54.762312+0000 2026-02-17T12:04:54.762 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:54.762312+0000 2026-02-17T12:04:54.762 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:54.762 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.762 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:04:54.762 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:04:54.762 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:04:54.762 INFO:teuthology.orchestra.run.trial119.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:04:54.763 INFO:teuthology.orchestra.run.trial119.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:04:54.763 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.766 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 1 Processor -- start 2026-02-17T12:04:54.766 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 1 -- start start 2026-02-17T12:04:54.766 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 10 monclient: init 2026-02-17T12:04:54.766 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:54.766 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 10 monclient: _add_conns ranks=[3,4,1,0,2] 2026-02-17T12:04:54.766 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f52ec0a89c0 0x7f52ec138380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.766 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 10 monclient(hunting): picked mon.noname-a con 0x7f52ec0a89c0 addr v2:10.20.193.77:3300/0 2026-02-17T12:04:54.766 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f52ec1388c0 0x7f52ec138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.767 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 10 monclient(hunting): picked mon.noname-c con 0x7f52ec1388c0 addr v2:10.20.193.119:3300/0 2026-02-17T12:04:54.767 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f52ec0a8da0 addr v1:10.20.193.119:6789/0 2026-02-17T12:04:54.767 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52ec09cf00 con 0x7f52ec0a8da0 2026-02-17T12:04:54.767 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.767 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f52ec0aa530 con 0x7f52ec0a89c0 2026-02-17T12:04:54.767 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.767 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f52ec0aa700 con 0x7f52ec1388c0 2026-02-17T12:04:54.767 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:54.768 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52f1995640 10 monclient(hunting): authenticate will time out at 541.389824s 2026-02-17T12:04:54.768 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f52ec1388c0 0x7f52ec138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.768 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52eb7fe640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f52ec0a8da0 0x7f52ec0a9250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:33408/0 (socket says 10.20.193.119:33408) 2026-02-17T12:04:54.768 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52eb7fe640 1 -- 10.20.193.119:0/1625678107 learned_addr learned my addr 10.20.193.119:0/1625678107 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-17T12:04:54.768 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 10 monclient(hunting): get_auth_request con 0x7f52ec1388c0 auth_method 0 2026-02-17T12:04:54.768 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.768 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.768 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.768 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52eaffd640 1 --2- 10.20.193.119:0/1625678107 >> v2:10.20.193.77:3300/0 conn(0x7f52ec0a89c0 0x7f52ec138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.768 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52eaffd640 10 monclient(hunting): get_auth_request con 0x7f52ec0a89c0 auth_method 0 2026-02-17T12:04:54.768 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.769 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.769 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.769 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.769 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.769 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:54.769 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.769 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.769 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:54.769 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 10 monclient(hunting): handle_auth_done global_id 4114 payload 274 2026-02-17T12:04:54.769 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 1 -- 10.20.193.119:0/1625678107 >> v2:10.20.193.77:3300/0 conn(0x7f52ec0a89c0 msgr2=0x7f52ec138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:54.770 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 1 --2- 10.20.193.119:0/1625678107 >> v2:10.20.193.77:3300/0 conn(0x7f52ec0a89c0 0x7f52ec138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.770 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 1 -- 10.20.193.119:0/1625678107 >> v1:10.20.193.119:6789/0 conn(0x7f52ec0a8da0 legacy=0x7f52ec0a9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:54.770 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:04:54.770 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 1 monclient: found mon.noname-c 2026-02-17T12:04:54.770 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:54.770 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.770 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.759+0000 7f52ea7fc640 1 -- 10.20.193.119:0/1625678107 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec09d1e0 con 0x7f52ec1388c0 2026-02-17T12:04:54.770 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 1 -- 10.20.193.119:0/1625678107 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f52ec1388c0 msgr2=0x7f52ec138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:54.770 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 1 --2- 10.20.193.119:0/1625678107 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f52ec1388c0 0x7f52ec138d10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f52ec069380 tx=0x7f52d401c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=989a3b9409145cdb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:54.777 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52e9ffb640 1 -- 10.20.193.119:0/1625678107 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40b0070 con 0x7f52ec1388c0 2026-02-17T12:04:54.777 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.777 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52e9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:54.778 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52e9ffb640 10 monclient: dump: 2026-02-17T12:04:54.778 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:54.778 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.778 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.778 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.778 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.778 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.778 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.778 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.778 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.778 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.779 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52e9ffb640 10 monclient: _finish_auth 0 2026-02-17T12:04:54.779 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52e9ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:04:54.779 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:54.779 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52e9ffb640 1 -- 10.20.193.119:0/1625678107 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d40ab600 con 0x7f52ec1388c0 2026-02-17T12:04:54.779 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52e9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:54.779 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52e9ffb640 1 -- 10.20.193.119:0/1625678107 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40ab9d0 con 0x7f52ec1388c0 2026-02-17T12:04:54.779 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 5 monclient: authenticate success, global_id 4114 2026-02-17T12:04:54.779 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:54.779 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 4 set_mon_vals no callback set 2026-02-17T12:04:54.779 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.779 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52e9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:54.780 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52e9ffb640 10 monclient: dump: 2026-02-17T12:04:54.780 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:54.780 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.780 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.780 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.780 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.780 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.780 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.780 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.780 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.780 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.780 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient: shutdown 2026-02-17T12:04:54.780 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:54.781 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 -- 10.20.193.119:0/1625678107 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f52ec1388c0 msgr2=0x7f52ec138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.781 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 --2- 10.20.193.119:0/1625678107 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f52ec1388c0 0x7f52ec138d10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f52ec069380 tx=0x7f52d401c280 comp rx=0 tx=0).stop 2026-02-17T12:04:54.781 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 -- 10.20.193.119:0/1625678107 shutdown_connections 2026-02-17T12:04:54.781 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 --2- 10.20.193.119:0/1625678107 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f52ec1388c0 0x7f52ec138d10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.781 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 --2- 10.20.193.119:0/1625678107 >> v2:10.20.193.77:3300/0 conn(0x7f52ec0a89c0 0x7f52ec138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.781 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 -- 10.20.193.119:0/1625678107 >> 10.20.193.119:0/1625678107 conn(0x7f52ec074c50 msgr2=0x7f52ec0aabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:54.781 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 -- 10.20.193.119:0/1625678107 shutdown_connections 2026-02-17T12:04:54.781 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 -- 10.20.193.119:0/1625678107 wait complete. 2026-02-17T12:04:54.781 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient: build_initial_monmap 2026-02-17T12:04:54.781 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient: monmap: 2026-02-17T12:04:54.781 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-17T12:04:54.781 INFO:teuthology.orchestra.run.trial119.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:54.782 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 0.000000 2026-02-17T12:04:54.782 INFO:teuthology.orchestra.run.trial119.stderr:created 0.000000 2026-02-17T12:04:54.782 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:54.782 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.782 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:04:54.782 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:04:54.782 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:04:54.782 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.782 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 Processor -- start 2026-02-17T12:04:54.782 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 -- start start 2026-02-17T12:04:54.782 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient: init 2026-02-17T12:04:54.782 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:54.782 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:04:54.783 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f52ec0a89c0 0x7f52ec1d2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.783 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient(hunting): picked mon.noname-c con 0x7f52ec0a89c0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:54.783 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f52ec0a8da0 0x7f52ec137630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.783 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient(hunting): picked mon.noname-b con 0x7f52ec0a8da0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:04:54.783 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f52ec1388c0 0x7f52ec13c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.783 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient(hunting): picked mon.noname-a con 0x7f52ec1388c0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:04:54.783 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.783 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec143190 con 0x7f52ec1388c0 2026-02-17T12:04:54.783 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.783 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec143010 con 0x7f52ec0a8da0 2026-02-17T12:04:54.783 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.783 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52ec143310 con 0x7f52ec0a89c0 2026-02-17T12:04:54.783 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:54.784 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52f1995640 10 monclient(hunting): authenticate will time out at 541.394862s 2026-02-17T12:04:54.784 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f52ec0a8da0 0x7f52ec137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.784 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f52ec0a8da0 0x7f52ec137630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.119:49936/0 (socket says 10.20.193.119:49936) 2026-02-17T12:04:54.784 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 1 -- 10.20.193.119:0/3846640173 learned_addr learned my addr 10.20.193.119:0/3846640173 (peer_addr_for_me v2:10.20.193.119:0/0) 2026-02-17T12:04:54.784 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 10 monclient(hunting): get_auth_request con 0x7f52ec0a8da0 auth_method 0 2026-02-17T12:04:54.784 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.784 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.784 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.784 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.784 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.785 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52eb7fe640 1 --2- 10.20.193.119:0/3846640173 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f52ec1388c0 0x7f52ec13c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.785 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:54.785 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52eaffd640 1 --2- 10.20.193.119:0/3846640173 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f52ec0a89c0 0x7f52ec1d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.785 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52eb7fe640 10 monclient(hunting): get_auth_request con 0x7f52ec1388c0 auth_method 0 2026-02-17T12:04:54.785 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.785 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.785 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.785 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52eaffd640 10 monclient(hunting): get_auth_request con 0x7f52ec0a89c0 auth_method 0 2026-02-17T12:04:54.785 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.785 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.785 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.786 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 10 monclient(hunting): handle_auth_done global_id 4117 payload 824 2026-02-17T12:04:54.786 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 1 -- 10.20.193.119:0/3846640173 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f52ec0a89c0 msgr2=0x7f52ec1d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.786 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 1 --2- 10.20.193.119:0/3846640173 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f52ec0a89c0 0x7f52ec1d2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.786 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 1 -- 10.20.193.119:0/3846640173 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f52ec1388c0 msgr2=0x7f52ec13c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.786 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 1 --2- 10.20.193.119:0/3846640173 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f52ec1388c0 0x7f52ec13c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.786 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:04:54.786 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 1 monclient: found mon.noname-b 2026-02-17T12:04:54.786 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:54.786 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.786 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52ea7fc640 1 -- 10.20.193.119:0/3846640173 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec0a7f80 con 0x7f52ec0a8da0 2026-02-17T12:04:54.786 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.763+0000 7f52eb7fe640 1 --2- 10.20.193.119:0/3846640173 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f52ec1388c0 0x7f52ec13c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:04:54.786 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52ea7fc640 1 -- 10.20.193.119:0/3846640173 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f52ec0a8da0 msgr2=0x7f52ec137630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:54.786 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52ea7fc640 1 --2- 10.20.193.119:0/3846640173 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f52ec0a8da0 0x7f52ec137630 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f52d401cb20 tx=0x7f52d4019020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:54.787 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 1 -- 10.20.193.119:0/3846640173 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40b8020 con 0x7f52ec0a8da0 2026-02-17T12:04:54.787 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.787 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:54.787 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 10 monclient: dump: 2026-02-17T12:04:54.787 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:54.787 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.787 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.787 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.787 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.787 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.787 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.788 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.788 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.788 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.788 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 10 monclient: _finish_auth 0 2026-02-17T12:04:54.788 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 10 monclient: _check_auth_tickets 2026-02-17T12:04:54.788 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:54.788 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 1 -- 10.20.193.119:0/3846640173 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d40b4810 con 0x7f52ec0a8da0 2026-02-17T12:04:54.788 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:54.788 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 1 -- 10.20.193.119:0/3846640173 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40b0040 con 0x7f52ec0a8da0 2026-02-17T12:04:54.788 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.788 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:54.789 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52e97fa640 4 set_mon_vals no callback set 2026-02-17T12:04:54.789 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 10 monclient: dump: 2026-02-17T12:04:54.789 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:54.789 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.789 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.789 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.789 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.789 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.789 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.789 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.789 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.789 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.789 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52f1995640 5 monclient: authenticate success, global_id 4117 2026-02-17T12:04:54.790 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52f1995640 10 monclient: _renew_subs 2026-02-17T12:04:54.790 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52f1995640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.790 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52f1995640 1 -- 10.20.193.119:0/3846640173 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ec0a3b90 con 0x7f52ec0a8da0 2026-02-17T12:04:54.790 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52f1995640 10 monclient: _renew_subs 2026-02-17T12:04:54.790 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52f1995640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.790 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52f1995640 1 -- 10.20.193.119:0/3846640173 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ec121fc0 con 0x7f52ec0a8da0 2026-02-17T12:04:54.790 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 1 -- 10.20.193.119:0/3846640173 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f52d40b4c40 con 0x7f52ec0a8da0 2026-02-17T12:04:54.790 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52c3fff640 1 -- 10.20.193.119:0/3846640173 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f52d40aa3a0 con 0x7f52ec0a8da0 2026-02-17T12:04:54.790 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52f1995640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:54.790 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52f1995640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:54.790 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52f1995640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.790 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.767+0000 7f52f1995640 1 -- 10.20.193.119:0/3846640173 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ec138380 con 0x7f52ec0a8da0 2026-02-17T12:04:54.791 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.771+0000 7f52c3fff640 1 -- 10.20.193.119:0/3846640173 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f52d40c2030 con 0x7f52ec0a8da0 2026-02-17T12:04:54.791 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.771+0000 7f52c3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:54.791 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.771+0000 7f52c3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:54.805 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "a82a493e-88de-4b65-ab23-41b52ffb6b61", "id": 1}] 2026-02-17T12:04:54.805 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "a82a493e-88de-4b65-ab23-41b52ffb6b61", "id": 1}] 2026-02-17T12:04:54.805 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.805 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 1 -- 10.20.193.119:0/3846640173 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a82a493e-88de-4b65-ab23-41b52ffb6b61", "id": 1} v 0) -- 0x7f52ec13ebb0 con 0x7f52ec0a8da0 2026-02-17T12:04:54.807 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52c3fff640 1 -- 10.20.193.119:0/3846640173 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a82a493e-88de-4b65-ab23-41b52ffb6b61", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f52ec09cf00 con 0x7f52ec0a8da0 2026-02-17T12:04:54.807 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52c3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "a82a493e-88de-4b65-ab23-41b52ffb6b61", "id": 1}] 2026-02-17T12:04:54.807 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52c3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:54.808 INFO:teuthology.orchestra.run.trial119.stdout:1 2026-02-17T12:04:54.809 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 10 monclient: shutdown 2026-02-17T12:04:54.809 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:54.809 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 1 -- 10.20.193.119:0/3846640173 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f52ec0a8da0 msgr2=0x7f52ec137630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.809 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 1 --2- 10.20.193.119:0/3846640173 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f52ec0a8da0 0x7f52ec137630 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f52d401cb20 tx=0x7f52d4019020 comp rx=0 tx=0).stop 2026-02-17T12:04:54.809 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 1 -- 10.20.193.119:0/3846640173 shutdown_connections 2026-02-17T12:04:54.809 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 1 --2- 10.20.193.119:0/3846640173 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f52ec1388c0 0x7f52ec13c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.809 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 1 --2- 10.20.193.119:0/3846640173 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f52ec0a8da0 0x7f52ec137630 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.810 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 1 --2- 10.20.193.119:0/3846640173 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f52ec0a89c0 0x7f52ec1d2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.810 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 1 -- 10.20.193.119:0/3846640173 >> 10.20.193.119:0/3846640173 conn(0x7f52ec074c50 msgr2=0x7f52ec13fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:54.810 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 1 -- 10.20.193.119:0/3846640173 shutdown_connections 2026-02-17T12:04:54.810 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.803+0000 7f52f1995640 1 -- 10.20.193.119:0/3846640173 wait complete. 2026-02-17T12:04:54.817 DEBUG:teuthology.orchestra.run.trial119:> sudo ceph --cluster ceph osd new 02ae9c66-fa9e-46d2-8be5-ba695ba4763b 2 2026-02-17T12:04:54.874 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 10 monclient: get_monmap_and_config 2026-02-17T12:04:54.874 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 10 monclient: build_initial_monmap 2026-02-17T12:04:54.874 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 10 monclient: monmap: 2026-02-17T12:04:54.874 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-17T12:04:54.874 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.874 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:54.874951+0000 2026-02-17T12:04:54.874 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:54.874951+0000 2026-02-17T12:04:54.874 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:54.875 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.875 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:04:54.875 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:04:54.875 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:04:54.875 INFO:teuthology.orchestra.run.trial119.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:04:54.875 INFO:teuthology.orchestra.run.trial119.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:04:54.875 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.877 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 1 Processor -- start 2026-02-17T12:04:54.877 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 1 -- start start 2026-02-17T12:04:54.877 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 10 monclient: init 2026-02-17T12:04:54.877 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:54.877 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 10 monclient: _add_conns ranks=[0,2,3,4,1] 2026-02-17T12:04:54.877 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc7c80a89c0 addr v1:10.20.193.77:6789/0 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7c8138a90 0x7fc7c813d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 10 monclient(hunting): picked mon.noname-b con 0x7fc7c8138a90 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fc7c8138f00 0x7fc7c813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 10 monclient(hunting): picked mon.noname-a con 0x7fc7c8138f00 addr v2:10.20.193.77:3300/0 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7c809cf00 con 0x7fc7c80a89c0 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc7c80aa530 con 0x7fc7c8138f00 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c80aa700 con 0x7fc7c8138a90 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7cce3f640 10 monclient(hunting): authenticate will time out at 541.502442s 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7c8138a90 0x7fc7c813d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c6d76640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fc7c8138f00 0x7fc7c813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7c8138a90 0x7fc7c813d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.119:49618/0 (socket says 10.20.193.119:49618) 2026-02-17T12:04:54.878 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 1 -- 10.20.193.119:0/944774184 learned_addr learned my addr 10.20.193.119:0/944774184 (peer_addr_for_me v2:10.20.193.119:0/0) 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 10 monclient(hunting): get_auth_request con 0x7fc7c8138a90 auth_method 0 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c6d76640 10 monclient(hunting): get_auth_request con 0x7fc7c8138f00 auth_method 0 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 10 monclient(hunting): handle_auth_done global_id 4115 payload 274 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 1 -- 10.20.193.119:0/944774184 >> v2:10.20.193.77:3300/0 conn(0x7fc7c8138f00 msgr2=0x7fc7c813fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 1 --2- 10.20.193.119:0/944774184 >> v2:10.20.193.77:3300/0 conn(0x7fc7c8138f00 0x7fc7c813fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.879 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 1 -- 10.20.193.119:0/944774184 >> v1:10.20.193.77:6789/0 conn(0x7fc7c80a89c0 legacy=0x7fc7c8138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:54.880 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 10 monclient: _finish_hunting 0 2026-02-17T12:04:54.880 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 1 monclient: found mon.noname-b 2026-02-17T12:04:54.880 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:54.880 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:04:54.880 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c5d74640 1 -- 10.20.193.119:0/944774184 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c809d1e0 con 0x7fc7c8138a90 2026-02-17T12:04:54.880 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.871+0000 7fc7c6d76640 1 --2- 10.20.193.119:0/944774184 >> v2:10.20.193.77:3300/0 conn(0x7fc7c8138f00 0x7fc7c813fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:04:54.881 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5d74640 1 -- 10.20.193.119:0/944774184 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7c8138a90 msgr2=0x7fc7c813d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:54.881 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5d74640 1 --2- 10.20.193.119:0/944774184 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7c8138a90 0x7fc7c813d7d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009970 tx=0x7fc7b001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ece78788f551f3b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:54.881 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5573640 1 -- 10.20.193.119:0/944774184 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b00b0070 con 0x7fc7c8138a90 2026-02-17T12:04:54.881 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.881 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5573640 10 monclient: dump: 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5573640 10 monclient: _finish_auth 0 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5573640 10 monclient: _check_auth_tickets 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 5 monclient: authenticate success, global_id 4115 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5573640 1 -- 10.20.193.119:0/944774184 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b0004230 con 0x7fc7c8138a90 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:54.882 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5573640 1 -- 10.20.193.119:0/944774184 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0003720 con 0x7fc7c8138a90 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 4 set_mon_vals no callback set 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5573640 10 monclient: dump: 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient: shutdown 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 -- 10.20.193.119:0/944774184 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7c8138a90 msgr2=0x7fc7c813d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 --2- 10.20.193.119:0/944774184 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7c8138a90 0x7fc7c813d7d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009970 tx=0x7fc7b001c360 comp rx=0 tx=0).stop 2026-02-17T12:04:54.883 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 -- 10.20.193.119:0/944774184 shutdown_connections 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 --2- 10.20.193.119:0/944774184 >> v2:10.20.193.77:3300/0 conn(0x7fc7c8138f00 0x7fc7c813fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 --2- 10.20.193.119:0/944774184 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7c8138a90 0x7fc7c813d7d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 -- 10.20.193.119:0/944774184 >> 10.20.193.119:0/944774184 conn(0x7fc7c8074c50 msgr2=0x7fc7c80aabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 -- 10.20.193.119:0/944774184 shutdown_connections 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 -- 10.20.193.119:0/944774184 wait complete. 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient: build_initial_monmap 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient: monmap: 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 0.000000 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:created 0.000000 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:04:54.884 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.884 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:54.875+0000 7f81fc7cf280 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T12:04:54.887 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 Processor -- start 2026-02-17T12:04:54.887 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 -- start start 2026-02-17T12:04:54.887 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient: init 2026-02-17T12:04:54.887 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:54.887 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:04:54.887 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7c80a89c0 0x7fc7c8139a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient(hunting): picked mon.noname-b con 0x7fc7c80a89c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7c8138a90 0x7fc7c8139f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient(hunting): picked mon.noname-c con 0x7fc7c8138a90 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7c8138f00 0x7fc7c813a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient(hunting): picked mon.noname-a con 0x7fc7c8138f00 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8142c00 con 0x7fc7c8138f00 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8142a80 con 0x7fc7c80a89c0 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c8142d80 con 0x7fc7c8138a90 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7cce3f640 10 monclient(hunting): authenticate will time out at 541.507687s 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7c80a89c0 0x7fc7c8139a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7c80a89c0 0x7fc7c8139a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.119:49952/0 (socket says 10.20.193.119:49952) 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 1 -- 10.20.193.119:0/2414620091 learned_addr learned my addr 10.20.193.119:0/2414620091 (peer_addr_for_me v2:10.20.193.119:0/0) 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 10 monclient(hunting): get_auth_request con 0x7fc7c80a89c0 auth_method 0 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.888 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6d76640 1 --2- 10.20.193.119:0/2414620091 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7c8138f00 0x7fc7c813a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6d76640 10 monclient(hunting): get_auth_request con 0x7fc7c8138f00 auth_method 0 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5d74640 1 --2- 10.20.193.119:0/2414620091 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7c8138a90 0x7fc7c8139f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5d74640 10 monclient(hunting): get_auth_request con 0x7fc7c8138a90 auth_method 0 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 10 monclient(hunting): handle_auth_done global_id 4120 payload 824 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 1 -- 10.20.193.119:0/2414620091 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7c8138a90 msgr2=0x7fc7c8139f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 1 --2- 10.20.193.119:0/2414620091 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7c8138a90 0x7fc7c8139f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 1 -- 10.20.193.119:0/2414620091 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7c8138f00 msgr2=0x7fc7c813a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 1 --2- 10.20.193.119:0/2414620091 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7c8138f00 0x7fc7c813a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 10 monclient: _finish_hunting 0 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 1 monclient: found mon.noname-b 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6575640 1 -- 10.20.193.119:0/2414620091 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c80a6ed0 con 0x7fc7c80a89c0 2026-02-17T12:04:54.889 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.875+0000 7fc7c6d76640 1 --2- 10.20.193.119:0/2414620091 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7c8138f00 0x7fc7c813a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7c6575640 1 -- 10.20.193.119:0/2414620091 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7c80a89c0 msgr2=0x7fc7c8139a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7c6575640 1 --2- 10.20.193.119:0/2414620091 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7c80a89c0 0x7fc7c8139a00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00c550 tx=0x7fc7bc00ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 1 -- 10.20.193.119:0/2414620091 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc016020 con 0x7fc7c80a89c0 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 10 monclient: dump: 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 10 monclient: _finish_auth 0 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 10 monclient: _check_auth_tickets 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 1 -- 10.20.193.119:0/2414620091 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc012a60 con 0x7fc7c80a89c0 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:54.890 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 1 -- 10.20.193.119:0/2414620091 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc012e50 con 0x7fc7c80a89c0 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7c4d72640 4 set_mon_vals no callback set 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 10 monclient: dump: 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7cce3f640 5 monclient: authenticate success, global_id 4120 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7cce3f640 10 monclient: _renew_subs 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7cce3f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7cce3f640 1 -- 10.20.193.119:0/2414620091 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c813d390 con 0x7fc7c80a89c0 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7cce3f640 10 monclient: _renew_subs 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7cce3f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7cce3f640 1 -- 10.20.193.119:0/2414620091 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c813fd80 con 0x7fc7c80a89c0 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 1 -- 10.20.193.119:0/2414620091 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc7bc01b790 con 0x7fc7c80a89c0 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7aeffd640 1 -- 10.20.193.119:0/2414620091 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc7bc01aca0 con 0x7fc7c80a89c0 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7cce3f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:54.891 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7cce3f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:54.892 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7cce3f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.892 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.879+0000 7fc7cce3f640 1 -- 10.20.193.119:0/2414620091 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7c8138380 con 0x7fc7c80a89c0 2026-02-17T12:04:54.892 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.883+0000 7fc7aeffd640 1 -- 10.20.193.119:0/2414620091 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fc7bc020020 con 0x7fc7c80a89c0 2026-02-17T12:04:54.892 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.883+0000 7fc7aeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:54.892 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.883+0000 7fc7aeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:54.916 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.911+0000 7fc7cce3f640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "02ae9c66-fa9e-46d2-8be5-ba695ba4763b", "id": 2}] 2026-02-17T12:04:54.916 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.911+0000 7fc7cce3f640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "02ae9c66-fa9e-46d2-8be5-ba695ba4763b", "id": 2}] 2026-02-17T12:04:54.916 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.911+0000 7fc7cce3f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.916 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.911+0000 7fc7cce3f640 1 -- 10.20.193.119:0/2414620091 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "02ae9c66-fa9e-46d2-8be5-ba695ba4763b", "id": 2} v 0) -- 0x7fc7c813bf40 con 0x7fc7c80a89c0 2026-02-17T12:04:54.919 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.915+0000 7fc7aeffd640 1 -- 10.20.193.119:0/2414620091 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "02ae9c66-fa9e-46d2-8be5-ba695ba4763b", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc7bc01a480 con 0x7fc7c80a89c0 2026-02-17T12:04:54.919 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.915+0000 7fc7aeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "02ae9c66-fa9e-46d2-8be5-ba695ba4763b", "id": 2}] 2026-02-17T12:04:54.919 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.915+0000 7fc7aeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:54.919 INFO:teuthology.orchestra.run.trial119.stdout:2 2026-02-17T12:04:54.920 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.915+0000 7fc7cce3f640 10 monclient: shutdown 2026-02-17T12:04:54.920 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.915+0000 7fc7cce3f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:54.921 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.915+0000 7fc7cce3f640 1 -- 10.20.193.119:0/2414620091 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7c80a89c0 msgr2=0x7fc7c8139a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:54.921 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.915+0000 7fc7cce3f640 1 --2- 10.20.193.119:0/2414620091 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7c80a89c0 0x7fc7c8139a00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00c550 tx=0x7fc7bc00ca10 comp rx=0 tx=0).stop 2026-02-17T12:04:54.921 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.915+0000 7fc7cce3f640 1 -- 10.20.193.119:0/2414620091 shutdown_connections 2026-02-17T12:04:54.921 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.915+0000 7fc7cce3f640 1 --2- 10.20.193.119:0/2414620091 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7c8138f00 0x7fc7c813a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.921 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.915+0000 7fc7cce3f640 1 --2- 10.20.193.119:0/2414620091 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7c8138a90 0x7fc7c8139f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.921 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.915+0000 7fc7cce3f640 1 --2- 10.20.193.119:0/2414620091 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7c80a89c0 0x7fc7c8139a00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:54.921 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.915+0000 7fc7cce3f640 1 -- 10.20.193.119:0/2414620091 >> 10.20.193.119:0/2414620091 conn(0x7fc7c8074c50 msgr2=0x7fc7c8137690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:54.921 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.915+0000 7fc7cce3f640 1 -- 10.20.193.119:0/2414620091 shutdown_connections 2026-02-17T12:04:54.921 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.915+0000 7fc7cce3f640 1 -- 10.20.193.119:0/2414620091 wait complete. 2026-02-17T12:04:54.929 DEBUG:teuthology.orchestra.run.trial119:> sudo ceph --cluster ceph osd new fe40e683-451d-4e8a-94f4-69ace432df28 3 2026-02-17T12:04:54.990 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 10 monclient: get_monmap_and_config 2026-02-17T12:04:54.990 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 10 monclient: build_initial_monmap 2026-02-17T12:04:54.990 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 10 monclient: monmap: 2026-02-17T12:04:54.990 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-17T12:04:54.990 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:54.990 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:54.990255+0000 2026-02-17T12:04:54.991 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:54.990255+0000 2026-02-17T12:04:54.991 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:54.991 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:54.991 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:04:54.991 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:04:54.991 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:04:54.991 INFO:teuthology.orchestra.run.trial119.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:04:54.991 INFO:teuthology.orchestra.run.trial119.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:04:54.991 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:54.991 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 1 Processor -- start 2026-02-17T12:04:54.991 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 1 -- start start 2026-02-17T12:04:54.992 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 10 monclient: init 2026-02-17T12:04:54.994 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:54.994 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 10 monclient: _add_conns ranks=[0,4,1,3,2] 2026-02-17T12:04:54.994 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f02c006c8e0 addr v1:10.20.193.77:6789/0 2026-02-17T12:04:54.994 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f02c006d3d0 0x7f02c013d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:54.994 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 10 monclient(hunting): picked mon.noname-c con 0x7f02c006d3d0 addr v2:10.20.193.119:3300/0 2026-02-17T12:04:54.994 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f02c013de20 addr v1:10.20.193.119:6789/0 2026-02-17T12:04:54.994 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c00a3750 con 0x7f02c006c8e0 2026-02-17T12:04:54.994 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c00a3d70 con 0x7f02c013de20 2026-02-17T12:04:54.994 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:54.995 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f02c006dd80 con 0x7f02c006d3d0 2026-02-17T12:04:54.995 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:54.995 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02c5514640 10 monclient(hunting): authenticate will time out at 541.617773s 2026-02-17T12:04:54.995 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f02c006d3d0 0x7f02c013d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:54.995 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f02c006d3d0 0x7f02c013d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.119:49956/0 (socket says 10.20.193.119:49956) 2026-02-17T12:04:54.995 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 1 -- 10.20.193.119:0/929343353 learned_addr learned my addr 10.20.193.119:0/929343353 (peer_addr_for_me v2:10.20.193.119:0/0) 2026-02-17T12:04:54.995 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 10 monclient(hunting): get_auth_request con 0x7f02c006d3d0 auth_method 0 2026-02-17T12:04:54.995 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02bf7fe640 1 --1- 10.20.193.119:0/929343353 >> v1:10.20.193.119:6789/0 conn(0x7f02c013de20 0x7f02c0140210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:33416/0 (socket says 10.20.193.119:33416) 2026-02-17T12:04:54.995 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:54.995 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:54.995 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:54.996 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:54.996 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:54.996 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:54.996 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 10 monclient(hunting): handle_auth_done global_id 4123 payload 274 2026-02-17T12:04:54.996 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 1 -- 10.20.193.119:0/929343353 >> v1:10.20.193.119:6789/0 conn(0x7f02c013de20 legacy=0x7f02c0140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:54.996 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 1 -- 10.20.193.119:0/929343353 >> v1:10.20.193.77:6789/0 conn(0x7f02c006c8e0 legacy=0x7f02c006ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:54.996 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:04:54.996 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 1 monclient: found mon.noname-c 2026-02-17T12:04:54.996 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:54.996 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.119:3300/0 2026-02-17T12:04:54.997 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.987+0000 7f02be7fc640 1 -- 10.20.193.119:0/929343353 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c009c6b0 con 0x7f02c006d3d0 2026-02-17T12:04:55.002 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02be7fc640 1 -- 10.20.193.119:0/929343353 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02c006d3d0 msgr2=0x7f02c013d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:55.002 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02be7fc640 1 --2- 10.20.193.119:0/929343353 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02c006d3d0 0x7f02c013d8e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f02a8009970 tx=0x7f02a801c5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61a78a3c762c55c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:55.002 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02bdffb640 1 -- 10.20.193.119:0/929343353 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a80b0070 con 0x7f02c006d3d0 2026-02-17T12:04:55.003 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.003 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02bdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:55.003 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02bdffb640 10 monclient: dump: 2026-02-17T12:04:55.003 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:55.003 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.003 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.003 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.003 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.003 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.003 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.003 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.003 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.004 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.004 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02bdffb640 10 monclient: _finish_auth 0 2026-02-17T12:04:55.004 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02bdffb640 10 monclient: _check_auth_tickets 2026-02-17T12:04:55.004 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02bdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:55.004 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02bdffb640 1 -- 10.20.193.119:0/929343353 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a8004230 con 0x7f02c006d3d0 2026-02-17T12:04:55.004 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02bdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:55.004 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02bdffb640 1 -- 10.20.193.119:0/929343353 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a8003720 con 0x7f02c006d3d0 2026-02-17T12:04:55.004 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 5 monclient: authenticate success, global_id 4123 2026-02-17T12:04:55.004 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:55.004 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 4 set_mon_vals no callback set 2026-02-17T12:04:55.004 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.004 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02bdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:55.005 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02bdffb640 10 monclient: dump: 2026-02-17T12:04:55.005 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:55.005 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.005 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.005 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.005 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.005 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.005 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.005 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.005 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.005 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.006 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient: shutdown 2026-02-17T12:04:55.006 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:55.006 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 -- 10.20.193.119:0/929343353 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02c006d3d0 msgr2=0x7f02c013d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.006 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 --2- 10.20.193.119:0/929343353 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02c006d3d0 0x7f02c013d8e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f02a8009970 tx=0x7f02a801c5d0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.006 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 -- 10.20.193.119:0/929343353 shutdown_connections 2026-02-17T12:04:55.006 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 --2- 10.20.193.119:0/929343353 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02c006d3d0 0x7f02c013d8e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.006 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 -- 10.20.193.119:0/929343353 >> 10.20.193.119:0/929343353 conn(0x7f02c00a4400 msgr2=0x7f02c00a4810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:55.006 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 -- 10.20.193.119:0/929343353 shutdown_connections 2026-02-17T12:04:55.006 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 -- 10.20.193.119:0/929343353 wait complete. 2026-02-17T12:04:55.006 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient: build_initial_monmap 2026-02-17T12:04:55.006 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient: monmap: 2026-02-17T12:04:55.006 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-17T12:04:55.007 INFO:teuthology.orchestra.run.trial119.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:55.007 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 0.000000 2026-02-17T12:04:55.007 INFO:teuthology.orchestra.run.trial119.stderr:created 0.000000 2026-02-17T12:04:55.007 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:55.007 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.007 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:04:55.007 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:04:55.007 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:04:55.007 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.007 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 Processor -- start 2026-02-17T12:04:55.007 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 -- start start 2026-02-17T12:04:55.007 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient: init 2026-02-17T12:04:55.007 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:55.008 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:04:55.008 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02c006c8e0 0x7f02c013bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.008 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient(hunting): picked mon.noname-b con 0x7f02c006c8e0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:04:55.008 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f02c006d3d0 0x7f02c013c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.008 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient(hunting): picked mon.noname-c con 0x7f02c006d3d0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:55.008 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f02c013de20 0x7f02c013c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.008 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient(hunting): picked mon.noname-a con 0x7f02c013de20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:04:55.008 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.008 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f02c00a3520 con 0x7f02c013de20 2026-02-17T12:04:55.008 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.008 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f02c00a33a0 con 0x7f02c006c8e0 2026-02-17T12:04:55.008 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.009 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f02c009b7a0 con 0x7f02c006d3d0 2026-02-17T12:04:55.009 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:55.009 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.991+0000 7f02c5514640 10 monclient(hunting): authenticate will time out at 541.623989s 2026-02-17T12:04:55.009 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02c006c8e0 0x7f02c013bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.009 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02c006c8e0 0x7f02c013bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.119:49964/0 (socket says 10.20.193.119:49964) 2026-02-17T12:04:55.009 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 1 -- 10.20.193.119:0/3020567904 learned_addr learned my addr 10.20.193.119:0/3020567904 (peer_addr_for_me v2:10.20.193.119:0/0) 2026-02-17T12:04:55.009 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 10 monclient(hunting): get_auth_request con 0x7f02c006c8e0 auth_method 0 2026-02-17T12:04:55.009 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.009 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.009 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.009 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:55.009 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:55.010 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:55.010 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02be7fc640 1 --2- 10.20.193.119:0/3020567904 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f02c006d3d0 0x7f02c013c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.010 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02be7fc640 10 monclient(hunting): get_auth_request con 0x7f02c006d3d0 auth_method 0 2026-02-17T12:04:55.010 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02be7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.010 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.010 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.010 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02bf7fe640 1 --2- 10.20.193.119:0/3020567904 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f02c013de20 0x7f02c013c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.010 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 10 monclient(hunting): handle_auth_done global_id 4126 payload 824 2026-02-17T12:04:55.010 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 1 -- 10.20.193.119:0/3020567904 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f02c006d3d0 msgr2=0x7f02c013c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.010 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 1 --2- 10.20.193.119:0/3020567904 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f02c006d3d0 0x7f02c013c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.010 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 1 -- 10.20.193.119:0/3020567904 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f02c013de20 msgr2=0x7f02c013c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.011 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 1 --2- 10.20.193.119:0/3020567904 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f02c013de20 0x7f02c013c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.011 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 10 monclient: _finish_hunting 0 2026-02-17T12:04:55.011 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 1 monclient: found mon.noname-b 2026-02-17T12:04:55.011 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:55.011 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.011 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 1 -- 10.20.193.119:0/3020567904 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c01415e0 con 0x7f02c006c8e0 2026-02-17T12:04:55.011 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02bf7fe640 10 monclient: get_auth_request con 0x7f02c013de20 auth_method 0 2026-02-17T12:04:55.011 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02bf7fe640 1 --2- 10.20.193.119:0/3020567904 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f02c013de20 0x7f02c013c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:04:55.011 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 1 -- 10.20.193.119:0/3020567904 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02c006c8e0 msgr2=0x7f02c013bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:55.011 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02beffd640 1 --2- 10.20.193.119:0/3020567904 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02c006c8e0 0x7f02c013bdd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f02b400c580 tx=0x7f02b400ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:55.011 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 1 -- 10.20.193.119:0/3020567904 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4016020 con 0x7f02c006c8e0 2026-02-17T12:04:55.011 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.011 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:55.012 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 10 monclient: dump: 2026-02-17T12:04:55.012 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:55.012 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.012 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.012 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.012 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.012 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.012 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.012 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.012 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.012 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.012 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:04:55.013 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:04:55.013 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:55.013 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 1 -- 10.20.193.119:0/3020567904 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b4012a60 con 0x7f02c006c8e0 2026-02-17T12:04:55.013 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:55.013 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 1 -- 10.20.193.119:0/3020567904 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4012e50 con 0x7f02c006c8e0 2026-02-17T12:04:55.013 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.013 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:55.013 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02bd7fa640 4 set_mon_vals no callback set 2026-02-17T12:04:55.013 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 10 monclient: dump: 2026-02-17T12:04:55.013 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:55.013 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.013 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.013 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.014 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.014 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.014 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.014 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.014 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.014 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.014 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02c5514640 5 monclient: authenticate success, global_id 4126 2026-02-17T12:04:55.014 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02c5514640 10 monclient: _renew_subs 2026-02-17T12:04:55.014 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02c5514640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.014 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02c5514640 1 -- 10.20.193.119:0/3020567904 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c013d920 con 0x7f02c006c8e0 2026-02-17T12:04:55.014 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02c5514640 10 monclient: _renew_subs 2026-02-17T12:04:55.014 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02c5514640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.015 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02c5514640 1 -- 10.20.193.119:0/3020567904 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c0072d20 con 0x7f02c006c8e0 2026-02-17T12:04:55.015 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 1 -- 10.20.193.119:0/3020567904 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f02b401b790 con 0x7f02c006c8e0 2026-02-17T12:04:55.015 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f029f7fe640 1 -- 10.20.193.119:0/3020567904 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f02b401acc0 con 0x7f02c006c8e0 2026-02-17T12:04:55.015 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02c5514640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:55.015 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02c5514640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:55.015 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02c5514640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.015 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.995+0000 7f02c5514640 1 -- 10.20.193.119:0/3020567904 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c006ccc0 con 0x7f02c006c8e0 2026-02-17T12:04:55.015 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.999+0000 7f029f7fe640 1 -- 10.20.193.119:0/3020567904 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f02b4020020 con 0x7f02c006c8e0 2026-02-17T12:04:55.015 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.999+0000 7f029f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:55.015 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:54.999+0000 7f029f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:55.033 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "fe40e683-451d-4e8a-94f4-69ace432df28", "id": 3}] 2026-02-17T12:04:55.033 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "fe40e683-451d-4e8a-94f4-69ace432df28", "id": 3}] 2026-02-17T12:04:55.033 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.033 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 1 -- 10.20.193.119:0/3020567904 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fe40e683-451d-4e8a-94f4-69ace432df28", "id": 3} v 0) -- 0x7f02c0074cc0 con 0x7f02c006c8e0 2026-02-17T12:04:55.036 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f029f7fe640 1 -- 10.20.193.119:0/3020567904 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe40e683-451d-4e8a-94f4-69ace432df28", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f02b401a3b0 con 0x7f02c006c8e0 2026-02-17T12:04:55.036 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f029f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "fe40e683-451d-4e8a-94f4-69ace432df28", "id": 3}] 2026-02-17T12:04:55.036 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f029f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:55.036 INFO:teuthology.orchestra.run.trial119.stdout:3 2026-02-17T12:04:55.037 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 10 monclient: shutdown 2026-02-17T12:04:55.037 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:55.037 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 1 -- 10.20.193.119:0/3020567904 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02c006c8e0 msgr2=0x7f02c013bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.037 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 1 --2- 10.20.193.119:0/3020567904 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02c006c8e0 0x7f02c013bdd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f02b400c580 tx=0x7f02b400ca40 comp rx=0 tx=0).stop 2026-02-17T12:04:55.038 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 1 -- 10.20.193.119:0/3020567904 shutdown_connections 2026-02-17T12:04:55.038 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 1 --2- 10.20.193.119:0/3020567904 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f02c013de20 0x7f02c013c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.038 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 1 --2- 10.20.193.119:0/3020567904 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f02c006d3d0 0x7f02c013c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.038 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 1 --2- 10.20.193.119:0/3020567904 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f02c006c8e0 0x7f02c013bdd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.038 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 1 -- 10.20.193.119:0/3020567904 >> 10.20.193.119:0/3020567904 conn(0x7f02c00a4400 msgr2=0x7f02c01389b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:55.038 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 1 -- 10.20.193.119:0/3020567904 shutdown_connections 2026-02-17T12:04:55.038 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.031+0000 7f02c5514640 1 -- 10.20.193.119:0/3020567904 wait complete. 2026-02-17T12:04:55.045 DEBUG:teuthology.orchestra.run.trial119:> sudo ceph --cluster ceph osd new e6fc84bb-bd81-49d5-8cfd-b4ab0468d8dc 4 2026-02-17T12:04:55.105 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 10 monclient: get_monmap_and_config 2026-02-17T12:04:55.105 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 10 monclient: build_initial_monmap 2026-02-17T12:04:55.105 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 10 monclient: monmap: 2026-02-17T12:04:55.105 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-17T12:04:55.105 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.106 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:55.105802+0000 2026-02-17T12:04:55.106 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:55.105802+0000 2026-02-17T12:04:55.106 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:55.106 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.106 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:04:55.106 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:04:55.106 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:04:55.106 INFO:teuthology.orchestra.run.trial119.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:04:55.106 INFO:teuthology.orchestra.run.trial119.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:04:55.106 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.109 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 1 Processor -- start 2026-02-17T12:04:55.109 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 1 -- start start 2026-02-17T12:04:55.109 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 10 monclient: init 2026-02-17T12:04:55.109 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:55.109 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 10 monclient: _add_conns ranks=[2,3,1,4,0] 2026-02-17T12:04:55.110 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56f40a89c0 0x7f56f4138380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.110 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 10 monclient(hunting): picked mon.noname-b con 0x7f56f40a89c0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:55.110 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f56f41388c0 0x7f56f4138d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.110 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 10 monclient(hunting): picked mon.noname-a con 0x7f56f41388c0 addr v2:10.20.193.77:3300/0 2026-02-17T12:04:55.110 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f56f40a8da0 addr v1:10.20.193.119:6789/0 2026-02-17T12:04:55.110 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f409cf00 con 0x7f56f40a8da0 2026-02-17T12:04:55.110 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.110 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f56f40aa530 con 0x7f56f41388c0 2026-02-17T12:04:55.110 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.110 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f56f40aa700 con 0x7f56f40a89c0 2026-02-17T12:04:55.111 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:55.111 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56fa274640 10 monclient(hunting): authenticate will time out at 541.733315s 2026-02-17T12:04:55.111 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f3fff640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f56f40a8da0 0x7f56f40a91f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:33426/0 (socket says 10.20.193.119:33426) 2026-02-17T12:04:55.111 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f3fff640 1 -- 10.20.193.119:0/360576194 learned_addr learned my addr 10.20.193.119:0/360576194 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-17T12:04:55.111 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 1 --2- 10.20.193.119:0/360576194 >> v2:10.20.193.77:3300/0 conn(0x7f56f41388c0 0x7f56f4138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.111 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 10 monclient(hunting): get_auth_request con 0x7f56f41388c0 auth_method 0 2026-02-17T12:04:55.111 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f37fe640 1 --2- 10.20.193.119:0/360576194 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56f40a89c0 0x7f56f4138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.111 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.111 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.111 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.111 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f37fe640 10 monclient(hunting): get_auth_request con 0x7f56f40a89c0 auth_method 0 2026-02-17T12:04:55.112 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.112 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.112 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.112 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:55.112 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:55.112 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:55.112 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:55.112 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:55.112 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:55.112 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 10 monclient(hunting): handle_auth_done global_id 4125 payload 274 2026-02-17T12:04:55.112 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 1 -- 10.20.193.119:0/360576194 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56f40a89c0 msgr2=0x7f56f4138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:55.112 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 1 --2- 10.20.193.119:0/360576194 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56f40a89c0 0x7f56f4138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.113 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 1 -- 10.20.193.119:0/360576194 >> v1:10.20.193.119:6789/0 conn(0x7f56f40a8da0 legacy=0x7f56f40a91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:55.113 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:04:55.113 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 1 monclient: found mon.noname-a 2026-02-17T12:04:55.113 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:55.113 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:04:55.113 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.103+0000 7f56f2ffd640 1 -- 10.20.193.119:0/360576194 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f409d1e0 con 0x7f56f41388c0 2026-02-17T12:04:55.118 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f2ffd640 1 -- 10.20.193.119:0/360576194 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56f41388c0 msgr2=0x7f56f4138d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:55.118 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f2ffd640 1 --2- 10.20.193.119:0/360576194 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56f41388c0 0x7f56f4138d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f56e40098c0 tx=0x7f56e401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5b07eed16539b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:55.119 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f27fc640 1 -- 10.20.193.119:0/360576194 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e40b0070 con 0x7f56f41388c0 2026-02-17T12:04:55.119 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.119 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:55.119 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f27fc640 10 monclient: dump: 2026-02-17T12:04:55.119 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:55.119 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.119 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.119 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.119 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.119 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.119 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.120 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.120 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.120 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.120 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f27fc640 10 monclient: _finish_auth 0 2026-02-17T12:04:55.120 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:04:55.120 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:55.120 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f27fc640 1 -- 10.20.193.119:0/360576194 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e40ab600 con 0x7f56f41388c0 2026-02-17T12:04:55.120 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:55.120 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f27fc640 1 -- 10.20.193.119:0/360576194 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e40ab9d0 con 0x7f56f41388c0 2026-02-17T12:04:55.120 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.120 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:55.120 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f27fc640 10 monclient: dump: 2026-02-17T12:04:55.121 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:55.121 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.121 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.121 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.121 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.121 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.121 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.121 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.121 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.121 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.121 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 5 monclient: authenticate success, global_id 4125 2026-02-17T12:04:55.122 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:55.122 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 4 set_mon_vals no callback set 2026-02-17T12:04:55.122 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient: shutdown 2026-02-17T12:04:55.122 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:55.122 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 -- 10.20.193.119:0/360576194 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56f41388c0 msgr2=0x7f56f4138d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.122 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 --2- 10.20.193.119:0/360576194 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56f41388c0 0x7f56f4138d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f56e40098c0 tx=0x7f56e401c330 comp rx=0 tx=0).stop 2026-02-17T12:04:55.122 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 -- 10.20.193.119:0/360576194 shutdown_connections 2026-02-17T12:04:55.122 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 --2- 10.20.193.119:0/360576194 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56f41388c0 0x7f56f4138d00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.122 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 --2- 10.20.193.119:0/360576194 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56f40a89c0 0x7f56f4138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.122 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 -- 10.20.193.119:0/360576194 >> 10.20.193.119:0/360576194 conn(0x7f56f4074c50 msgr2=0x7f56f40aabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:55.122 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 -- 10.20.193.119:0/360576194 shutdown_connections 2026-02-17T12:04:55.123 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 -- 10.20.193.119:0/360576194 wait complete. 2026-02-17T12:04:55.123 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient: build_initial_monmap 2026-02-17T12:04:55.123 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient: monmap: 2026-02-17T12:04:55.123 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-17T12:04:55.123 INFO:teuthology.orchestra.run.trial119.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:55.123 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 0.000000 2026-02-17T12:04:55.123 INFO:teuthology.orchestra.run.trial119.stderr:created 0.000000 2026-02-17T12:04:55.123 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:55.123 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.123 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:04:55.123 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:04:55.123 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:04:55.124 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.124 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 Processor -- start 2026-02-17T12:04:55.124 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 -- start start 2026-02-17T12:04:55.124 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient: init 2026-02-17T12:04:55.124 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:55.124 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:04:55.124 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56f40a89c0 0x7f56f413dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.124 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient(hunting): picked mon.noname-a con 0x7f56f40a89c0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:04:55.124 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56f40a8da0 0x7f56f413dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.124 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient(hunting): picked mon.noname-c con 0x7f56f40a8da0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:55.124 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f56f41388c0 0x7f56f413e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.125 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient(hunting): picked mon.noname-b con 0x7f56f41388c0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:04:55.125 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.125 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f56f4143190 con 0x7f56f40a89c0 2026-02-17T12:04:55.125 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.125 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f56f4143010 con 0x7f56f41388c0 2026-02-17T12:04:55.125 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.125 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f56f4143310 con 0x7f56f40a8da0 2026-02-17T12:04:55.125 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:55.125 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56fa274640 10 monclient(hunting): authenticate will time out at 541.738269s 2026-02-17T12:04:55.125 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f56f41388c0 0x7f56f413e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.125 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f56f41388c0 0x7f56f413e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.119:49972/0 (socket says 10.20.193.119:49972) 2026-02-17T12:04:55.125 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 1 -- 10.20.193.119:0/2096830613 learned_addr learned my addr 10.20.193.119:0/2096830613 (peer_addr_for_me v2:10.20.193.119:0/0) 2026-02-17T12:04:55.126 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 10 monclient(hunting): get_auth_request con 0x7f56f41388c0 auth_method 0 2026-02-17T12:04:55.126 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.126 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.126 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.126 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:55.126 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:55.126 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:55.126 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f2ffd640 1 --2- 10.20.193.119:0/2096830613 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56f40a8da0 0x7f56f413dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.126 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f2ffd640 10 monclient(hunting): get_auth_request con 0x7f56f40a8da0 auth_method 0 2026-02-17T12:04:55.126 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f37fe640 1 --2- 10.20.193.119:0/2096830613 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56f40a89c0 0x7f56f413dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.126 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.126 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.127 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.127 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f37fe640 10 monclient(hunting): get_auth_request con 0x7f56f40a89c0 auth_method 0 2026-02-17T12:04:55.127 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.127 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.127 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.127 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 10 monclient(hunting): handle_auth_done global_id 4129 payload 824 2026-02-17T12:04:55.127 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 1 -- 10.20.193.119:0/2096830613 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56f40a8da0 msgr2=0x7f56f413dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.127 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 1 --2- 10.20.193.119:0/2096830613 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56f40a8da0 0x7f56f413dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.127 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 1 -- 10.20.193.119:0/2096830613 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56f40a89c0 msgr2=0x7f56f413dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.127 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 1 --2- 10.20.193.119:0/2096830613 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56f40a89c0 0x7f56f413dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.127 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 10 monclient: _finish_hunting 0 2026-02-17T12:04:55.127 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 1 monclient: found mon.noname-b 2026-02-17T12:04:55.128 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:55.128 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.128 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.107+0000 7f56f3fff640 1 -- 10.20.193.119:0/2096830613 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f40709e0 con 0x7f56f41388c0 2026-02-17T12:04:55.128 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56f3fff640 1 -- 10.20.193.119:0/2096830613 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f56f41388c0 msgr2=0x7f56f413e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:55.128 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56f3fff640 1 --2- 10.20.193.119:0/2096830613 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f56f41388c0 0x7f56f413e530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f56e800cb20 tx=0x7f56e800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:55.128 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 1 -- 10.20.193.119:0/2096830613 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8012400 con 0x7f56f41388c0 2026-02-17T12:04:55.128 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.128 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:55.128 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 10 monclient: dump: 2026-02-17T12:04:55.128 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:55.128 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.128 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.129 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.129 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.129 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.129 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.129 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.129 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.129 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.129 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 10 monclient: _finish_auth 0 2026-02-17T12:04:55.129 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 10 monclient: _check_auth_tickets 2026-02-17T12:04:55.129 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:55.129 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 1 -- 10.20.193.119:0/2096830613 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e80125a0 con 0x7f56f41388c0 2026-02-17T12:04:55.129 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:55.130 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 1 -- 10.20.193.119:0/2096830613 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8012990 con 0x7f56f41388c0 2026-02-17T12:04:55.130 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.130 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:55.130 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56f1ffb640 4 set_mon_vals no callback set 2026-02-17T12:04:55.130 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 10 monclient: dump: 2026-02-17T12:04:55.130 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:55.130 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.130 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.130 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.130 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.130 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.130 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.130 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.131 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.131 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.131 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56fa274640 5 monclient: authenticate success, global_id 4129 2026-02-17T12:04:55.131 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56fa274640 10 monclient: _renew_subs 2026-02-17T12:04:55.131 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56fa274640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.131 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56fa274640 1 -- 10.20.193.119:0/2096830613 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f4070cc0 con 0x7f56f41388c0 2026-02-17T12:04:55.131 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56fa274640 10 monclient: _renew_subs 2026-02-17T12:04:55.131 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56fa274640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.131 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56fa274640 1 -- 10.20.193.119:0/2096830613 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f40a3b30 con 0x7f56f41388c0 2026-02-17T12:04:55.131 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 1 -- 10.20.193.119:0/2096830613 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f56e8012b70 con 0x7f56f41388c0 2026-02-17T12:04:55.131 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 1 -- 10.20.193.119:0/2096830613 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f56e801b910 con 0x7f56f41388c0 2026-02-17T12:04:55.131 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56fa274640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:55.132 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56fa274640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:55.132 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56fa274640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.132 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56fa274640 1 -- 10.20.193.119:0/2096830613 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f4138380 con 0x7f56f41388c0 2026-02-17T12:04:55.132 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 1 -- 10.20.193.119:0/2096830613 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f56e801b400 con 0x7f56f41388c0 2026-02-17T12:04:55.132 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:55.132 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.111+0000 7f56cffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:55.147 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.143+0000 7f56fa274640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e6fc84bb-bd81-49d5-8cfd-b4ab0468d8dc", "id": 4}] 2026-02-17T12:04:55.147 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.143+0000 7f56fa274640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e6fc84bb-bd81-49d5-8cfd-b4ab0468d8dc", "id": 4}] 2026-02-17T12:04:55.148 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.143+0000 7f56fa274640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.148 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.143+0000 7f56fa274640 1 -- 10.20.193.119:0/2096830613 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e6fc84bb-bd81-49d5-8cfd-b4ab0468d8dc", "id": 4} v 0) -- 0x7f56f409e790 con 0x7f56f41388c0 2026-02-17T12:04:55.150 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.147+0000 7f56cffff640 1 -- 10.20.193.119:0/2096830613 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e6fc84bb-bd81-49d5-8cfd-b4ab0468d8dc", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f56e801b5e0 con 0x7f56f41388c0 2026-02-17T12:04:55.150 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.147+0000 7f56cffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e6fc84bb-bd81-49d5-8cfd-b4ab0468d8dc", "id": 4}] 2026-02-17T12:04:55.150 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.147+0000 7f56cffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:55.150 INFO:teuthology.orchestra.run.trial119.stdout:4 2026-02-17T12:04:55.151 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.147+0000 7f56fa274640 10 monclient: shutdown 2026-02-17T12:04:55.151 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.147+0000 7f56fa274640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:55.152 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.147+0000 7f56fa274640 1 -- 10.20.193.119:0/2096830613 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f56f41388c0 msgr2=0x7f56f413e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.152 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.147+0000 7f56fa274640 1 --2- 10.20.193.119:0/2096830613 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f56f41388c0 0x7f56f413e530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f56e800cb20 tx=0x7f56e800a060 comp rx=0 tx=0).stop 2026-02-17T12:04:55.152 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.147+0000 7f56fa274640 1 -- 10.20.193.119:0/2096830613 shutdown_connections 2026-02-17T12:04:55.152 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.147+0000 7f56fa274640 1 --2- 10.20.193.119:0/2096830613 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f56f41388c0 0x7f56f413e530 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.152 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.147+0000 7f56fa274640 1 --2- 10.20.193.119:0/2096830613 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56f40a8da0 0x7f56f413dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.152 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.147+0000 7f56fa274640 1 --2- 10.20.193.119:0/2096830613 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56f40a89c0 0x7f56f413dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.152 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.147+0000 7f56fa274640 1 -- 10.20.193.119:0/2096830613 >> 10.20.193.119:0/2096830613 conn(0x7f56f4074c50 msgr2=0x7f56f40a0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:55.152 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.147+0000 7f56fa274640 1 -- 10.20.193.119:0/2096830613 shutdown_connections 2026-02-17T12:04:55.152 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.147+0000 7f56fa274640 1 -- 10.20.193.119:0/2096830613 wait complete. 2026-02-17T12:04:55.159 DEBUG:teuthology.orchestra.run.trial119:> sudo ceph --cluster ceph osd new 400ef2a1-c8ee-4376-b3d9-588e2a34ad9f 5 2026-02-17T12:04:55.184 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:55.179+0000 7f81fc7cf280 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T12:04:55.219 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 10 monclient: get_monmap_and_config 2026-02-17T12:04:55.219 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 10 monclient: build_initial_monmap 2026-02-17T12:04:55.219 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 10 monclient: monmap: 2026-02-17T12:04:55.219 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-17T12:04:55.219 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.219 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:55.219979+0000 2026-02-17T12:04:55.219 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:55.219979+0000 2026-02-17T12:04:55.220 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:55.220 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.220 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:04:55.220 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:04:55.220 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:04:55.220 INFO:teuthology.orchestra.run.trial119.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:04:55.220 INFO:teuthology.orchestra.run.trial119.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:04:55.220 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.223 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 1 Processor -- start 2026-02-17T12:04:55.223 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 1 -- start start 2026-02-17T12:04:55.223 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 10 monclient: init 2026-02-17T12:04:55.223 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:55.223 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 10 monclient: _add_conns ranks=[4,0,2,3,1] 2026-02-17T12:04:55.223 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f3d0c0a52b0 0x7f3d0c0a5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.223 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 10 monclient(hunting): picked mon.noname-c con 0x7f3d0c0a52b0 addr v2:10.20.193.119:3300/0 2026-02-17T12:04:55.223 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3d0c09d750 addr v1:10.20.193.77:6789/0 2026-02-17T12:04:55.223 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3d0c0a5bd0 0x7f3d0c138780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.223 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 10 monclient(hunting): picked mon.noname-b con 0x7f3d0c0a5bd0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:55.223 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d0c0a6620 con 0x7f3d0c09d750 2026-02-17T12:04:55.223 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.223 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f3d0c0a6a30 con 0x7f3d0c0a52b0 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3d0c09c540 con 0x7f3d0c0a5bd0 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12b38640 10 monclient(hunting): authenticate will time out at 541.847478s 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f3d0c0a52b0 0x7f3d0c0a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f3d0c0a52b0 0x7f3d0c0a5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.119:49976/0 (socket says 10.20.193.119:49976) 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 1 -- 10.20.193.119:0/2622971379 learned_addr learned my addr 10.20.193.119:0/2622971379 (peer_addr_for_me v2:10.20.193.119:0/0) 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 10 monclient(hunting): get_auth_request con 0x7f3d0c0a52b0 auth_method 0 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12337640 1 --2- 10.20.193.119:0/2622971379 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3d0c0a5bd0 0x7f3d0c138780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12337640 10 monclient(hunting): get_auth_request con 0x7f3d0c0a5bd0 auth_method 0 2026-02-17T12:04:55.224 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12337640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.225 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12337640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.225 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d12337640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.225 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 10 monclient(hunting): handle_auth_done global_id 4132 payload 274 2026-02-17T12:04:55.225 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 1 -- 10.20.193.119:0/2622971379 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3d0c0a5bd0 msgr2=0x7f3d0c138780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:55.225 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 1 --2- 10.20.193.119:0/2622971379 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3d0c0a5bd0 0x7f3d0c138780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.225 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 1 -- 10.20.193.119:0/2622971379 >> v1:10.20.193.77:6789/0 conn(0x7f3d0c09d750 legacy=0x7f3d0c138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:55.225 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 10 monclient: _finish_hunting 0 2026-02-17T12:04:55.225 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 1 monclient: found mon.noname-c 2026-02-17T12:04:55.225 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:55.225 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.225 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.215+0000 7f3d11b36640 1 -- 10.20.193.119:0/2622971379 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c09be20 con 0x7f3d0c0a52b0 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d11b36640 1 -- 10.20.193.119:0/2622971379 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3d0c0a52b0 msgr2=0x7f3d0c0a5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d11b36640 1 --2- 10.20.193.119:0/2622971379 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3d0c0a52b0 0x7f3d0c0a5690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009970 tx=0x7f3cfc01c570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc8b56f80dcb7e66 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d10b34640 1 -- 10.20.193.119:0/2622971379 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc0b0070 con 0x7f3d0c0a52b0 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d10b34640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d10b34640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d10b34640 10 monclient: dump: 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.229 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d10b34640 10 monclient: _finish_auth 0 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d10b34640 10 monclient: _check_auth_tickets 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d10b34640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d10b34640 1 -- 10.20.193.119:0/2622971379 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cfc004230 con 0x7f3d0c0a52b0 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d10b34640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d12b38640 5 monclient: authenticate success, global_id 4132 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d10b34640 1 -- 10.20.193.119:0/2622971379 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc003720 con 0x7f3d0c0a52b0 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d10b34640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d10b34640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d10b34640 10 monclient: dump: 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.230 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d12b38640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d12b38640 4 set_mon_vals no callback set 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d12b38640 10 monclient: shutdown 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d12b38640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d12b38640 1 -- 10.20.193.119:0/2622971379 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3d0c0a52b0 msgr2=0x7f3d0c0a5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d12b38640 1 --2- 10.20.193.119:0/2622971379 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3d0c0a52b0 0x7f3d0c0a5690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009970 tx=0x7f3cfc01c570 comp rx=0 tx=0).stop 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d12b38640 1 -- 10.20.193.119:0/2622971379 shutdown_connections 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d12b38640 1 --2- 10.20.193.119:0/2622971379 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3d0c0a5bd0 0x7f3d0c138780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d12b38640 1 --2- 10.20.193.119:0/2622971379 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3d0c0a52b0 0x7f3d0c0a5690 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d12b38640 1 -- 10.20.193.119:0/2622971379 >> 10.20.193.119:0/2622971379 conn(0x7f3d0c0a73b0 msgr2=0x7f3d0c0a77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d12b38640 1 -- 10.20.193.119:0/2622971379 shutdown_connections 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.219+0000 7f3d12b38640 1 -- 10.20.193.119:0/2622971379 wait complete. 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient: build_initial_monmap 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient: monmap: 2026-02-17T12:04:55.231 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 0.000000 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:created 0.000000 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 1 Processor -- start 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 1 -- start start 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient: init 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3d0c09d750 0x7f3d0c1d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient(hunting): picked mon.noname-c con 0x7f3d0c09d750 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f3d0c0a52b0 0x7f3d0c137ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient(hunting): picked mon.noname-a con 0x7f3d0c0a52b0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3d0c0a5bd0 0x7f3d0c13df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.232 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient(hunting): picked mon.noname-b con 0x7f3d0c0a5bd0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c06f640 con 0x7f3d0c0a52b0 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c06f4c0 con 0x7f3d0c0a5bd0 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3d0c138cc0 con 0x7f3d0c09d750 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient(hunting): authenticate will time out at 541.852504s 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3d0c0a5bd0 0x7f3d0c13df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3d0c0a5bd0 0x7f3d0c13df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.119:49978/0 (socket says 10.20.193.119:49978) 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 1 -- 10.20.193.119:0/1392446341 learned_addr learned my addr 10.20.193.119:0/1392446341 (peer_addr_for_me v2:10.20.193.119:0/0) 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 10 monclient(hunting): get_auth_request con 0x7f3d0c0a5bd0 auth_method 0 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d11b36640 1 --2- 10.20.193.119:0/1392446341 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3d0c09d750 0x7f3d0c1d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d11335640 1 --2- 10.20.193.119:0/1392446341 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f3d0c0a52b0 0x7f3d0c137ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d11b36640 10 monclient(hunting): get_auth_request con 0x7f3d0c09d750 auth_method 0 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d11b36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.233 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d11b36640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d11b36640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d11335640 10 monclient(hunting): get_auth_request con 0x7f3d0c0a52b0 auth_method 0 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d11335640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d11335640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d11335640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d11b36640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d11b36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d11b36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 10 monclient(hunting): handle_auth_done global_id 4135 payload 824 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 1 -- 10.20.193.119:0/1392446341 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3d0c09d750 msgr2=0x7f3d0c1d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 1 --2- 10.20.193.119:0/1392446341 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3d0c09d750 0x7f3d0c1d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 1 -- 10.20.193.119:0/1392446341 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f3d0c0a52b0 msgr2=0x7f3d0c137ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 1 --2- 10.20.193.119:0/1392446341 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f3d0c0a52b0 0x7f3d0c137ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 10 monclient: _finish_hunting 0 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 1 monclient: found mon.noname-b 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 1 -- 10.20.193.119:0/1392446341 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c122850 con 0x7f3d0c0a5bd0 2026-02-17T12:04:55.234 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d11335640 1 --2- 10.20.193.119:0/1392446341 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f3d0c0a52b0 0x7f3d0c137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 1 -- 10.20.193.119:0/1392446341 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3d0c0a5bd0 msgr2=0x7f3d0c13df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12337640 1 --2- 10.20.193.119:0/1392446341 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3d0c0a5bd0 0x7f3d0c13df40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3d08007e40 tx=0x7f3d0800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 1 -- 10.20.193.119:0/1392446341 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08013790 con 0x7f3d0c0a5bd0 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 10 monclient: dump: 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 10 monclient: _finish_auth 0 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 1 -- 10.20.193.119:0/1392446341 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d08019070 con 0x7f3d0c0a5bd0 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 5 monclient: authenticate success, global_id 4135 2026-02-17T12:04:55.235 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient: _renew_subs 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 1 -- 10.20.193.119:0/1392446341 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d0c121fb0 con 0x7f3d0c0a5bd0 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 1 -- 10.20.193.119:0/1392446341 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08013b90 con 0x7f3d0c0a5bd0 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfbfff640 4 set_mon_vals no callback set 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 10 monclient: dump: 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient: _renew_subs 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 1 -- 10.20.193.119:0/1392446341 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d0c121490 con 0x7f3d0c0a5bd0 2026-02-17T12:04:55.236 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 1 -- 10.20.193.119:0/1392446341 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f3d0801e460 con 0x7f3d0c0a5bd0 2026-02-17T12:04:55.237 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3cfa7fc640 1 -- 10.20.193.119:0/1392446341 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f3d08014ad0 con 0x7f3d0c0a5bd0 2026-02-17T12:04:55.237 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:55.237 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:55.237 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.237 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.223+0000 7f3d12b38640 1 -- 10.20.193.119:0/1392446341 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d0c0a5690 con 0x7f3d0c0a5bd0 2026-02-17T12:04:55.237 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.227+0000 7f3cfa7fc640 1 -- 10.20.193.119:0/1392446341 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f3d08014df0 con 0x7f3d0c0a5bd0 2026-02-17T12:04:55.237 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.227+0000 7f3cfa7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:55.237 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.227+0000 7f3cfa7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:55.262 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.259+0000 7f3d12b38640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "400ef2a1-c8ee-4376-b3d9-588e2a34ad9f", "id": 5}] 2026-02-17T12:04:55.262 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.259+0000 7f3d12b38640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "400ef2a1-c8ee-4376-b3d9-588e2a34ad9f", "id": 5}] 2026-02-17T12:04:55.262 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.259+0000 7f3d12b38640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:04:55.262 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.259+0000 7f3d12b38640 1 -- 10.20.193.119:0/1392446341 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "400ef2a1-c8ee-4376-b3d9-588e2a34ad9f", "id": 5} v 0) -- 0x7f3d0c1224d0 con 0x7f3d0c0a5bd0 2026-02-17T12:04:55.277 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:55.275+0000 7f81fc7cf280 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T12:04:55.304 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:55.299+0000 7f81fc7cf280 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T12:04:55.335 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:55.331+0000 7f81fc7cf280 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T12:04:55.377 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:55.375+0000 7f81fc7cf280 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T12:04:55.476 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:55.471+0000 7f81fc7cf280 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:04:55.667 INFO:tasks.ceph.mgr.x.trial119.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-17T12:04:55.751 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.747+0000 7f3cfa7fc640 1 -- 10.20.193.119:0/1392446341 <== mon.1 v2:10.20.193.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "400ef2a1-c8ee-4376-b3d9-588e2a34ad9f", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f3d08014510 con 0x7f3d0c0a5bd0 2026-02-17T12:04:55.751 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.747+0000 7f3cfa7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "400ef2a1-c8ee-4376-b3d9-588e2a34ad9f", "id": 5}] 2026-02-17T12:04:55.751 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.747+0000 7f3cfa7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:55.752 INFO:teuthology.orchestra.run.trial119.stdout:5 2026-02-17T12:04:55.753 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.747+0000 7f3d12b38640 10 monclient: shutdown 2026-02-17T12:04:55.753 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.747+0000 7f3d12b38640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:55.753 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.747+0000 7f3d12b38640 1 -- 10.20.193.119:0/1392446341 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3d0c0a5bd0 msgr2=0x7f3d0c13df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.753 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.747+0000 7f3d12b38640 1 --2- 10.20.193.119:0/1392446341 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3d0c0a5bd0 0x7f3d0c13df40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3d08007e40 tx=0x7f3d0800e4b0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.753 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.747+0000 7f3d12b38640 1 -- 10.20.193.119:0/1392446341 shutdown_connections 2026-02-17T12:04:55.753 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.747+0000 7f3d12b38640 1 --2- 10.20.193.119:0/1392446341 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3d0c0a5bd0 0x7f3d0c13df40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.753 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.747+0000 7f3d12b38640 1 --2- 10.20.193.119:0/1392446341 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f3d0c0a52b0 0x7f3d0c137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.753 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.747+0000 7f3d12b38640 1 --2- 10.20.193.119:0/1392446341 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3d0c09d750 0x7f3d0c1d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.753 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.747+0000 7f3d12b38640 1 -- 10.20.193.119:0/1392446341 >> 10.20.193.119:0/1392446341 conn(0x7f3d0c0a73b0 msgr2=0x7f3d0c0a9640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:55.754 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.747+0000 7f3d12b38640 1 -- 10.20.193.119:0/1392446341 shutdown_connections 2026-02-17T12:04:55.754 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-17T12:04:55.747+0000 7f3d12b38640 1 -- 10.20.193.119:0/1392446341 wait complete. 2026-02-17T12:04:55.761 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T12:04:55.761 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T12:04:55.763 INFO:tasks.ceph.osd.0:Started 2026-02-17T12:04:55.763 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T12:04:55.763 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T12:04:55.765 INFO:tasks.ceph.osd.1:Started 2026-02-17T12:04:55.765 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T12:04:55.766 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T12:04:55.768 INFO:tasks.ceph.osd.2:Started 2026-02-17T12:04:55.768 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-17T12:04:55.768 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-17T12:04:55.806 INFO:tasks.ceph.osd.3:Started 2026-02-17T12:04:55.806 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-17T12:04:55.806 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-17T12:04:55.809 INFO:tasks.ceph.osd.4:Started 2026-02-17T12:04:55.809 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-17T12:04:55.809 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-17T12:04:55.811 INFO:tasks.ceph.osd.5:Started 2026-02-17T12:04:55.811 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T12:04:55.842 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:55.839+0000 7f81fc7cf280 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T12:04:55.875 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:55.871+0000 7f81fc7cf280 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T12:04:55.877 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.875+0000 7fdac24d8640 10 monclient: get_monmap_and_config 2026-02-17T12:04:55.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.875+0000 7fdac24d8640 10 monclient: build_initial_monmap 2026-02-17T12:04:55.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.875+0000 7fdac24d8640 10 monclient: monmap: 2026-02-17T12:04:55.878 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:04:55.878 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.878 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:55.880858+0000 2026-02-17T12:04:55.878 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:55.880858+0000 2026-02-17T12:04:55.878 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:55.878 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:04:55.878 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:04:55.878 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:04:55.879 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:04:55.879 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:04:55.879 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:04:55.879 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:04:55.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.875+0000 7fdac24d8640 1 Processor -- start 2026-02-17T12:04:55.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 1 -- start start 2026-02-17T12:04:55.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 10 monclient: init 2026-02-17T12:04:55.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:55.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 10 monclient: _add_conns ranks=[4,1,2,0,3] 2026-02-17T12:04:55.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fdabc09be20 0x7fdabc134e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 10 monclient(hunting): picked mon.noname-c con 0x7fdabc09be20 addr v2:10.20.193.119:3300/0 2026-02-17T12:04:55.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdabc0a4c20 addr v1:10.20.193.119:6789/0 2026-02-17T12:04:55.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a5070 0x7fdabc138800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 10 monclient(hunting): picked mon.noname-b con 0x7fdabc0a5070 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:55.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdabc09cdf0 con 0x7fdabc0a4c20 2026-02-17T12:04:55.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fdabc09c200 con 0x7fdabc09be20 2026-02-17T12:04:55.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdabc09d0d0 con 0x7fdabc0a5070 2026-02-17T12:04:55.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:55.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac24d8640 10 monclient(hunting): authenticate will time out at 547.556501s 2026-02-17T12:04:55.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a5070 0x7fdabc138800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a5070 0x7fdabc138800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:43952/0 (socket says 10.20.193.77:43952) 2026-02-17T12:04:55.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 1 -- 10.20.193.77:0/3828834471 learned_addr learned my addr 10.20.193.77:0/3828834471 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:04:55.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 10 monclient(hunting): get_auth_request con 0x7fdabc0a5070 auth_method 0 2026-02-17T12:04:55.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdabbfff640 1 --2- 10.20.193.77:0/3828834471 >> v2:10.20.193.119:3300/0 conn(0x7fdabc09be20 0x7fdabc134e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:55.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:55.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:55.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdabbfff640 10 monclient(hunting): get_auth_request con 0x7fdabc09be20 auth_method 0 2026-02-17T12:04:55.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdabbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdabbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdabbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 10 monclient(hunting): handle_auth_done global_id 4145 payload 274 2026-02-17T12:04:55.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 1 -- 10.20.193.77:0/3828834471 >> v2:10.20.193.119:3300/0 conn(0x7fdabc09be20 msgr2=0x7fdabc134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:55.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 1 --2- 10.20.193.77:0/3828834471 >> v2:10.20.193.119:3300/0 conn(0x7fdabc09be20 0x7fdabc134e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 1 -- 10.20.193.77:0/3828834471 >> v1:10.20.193.119:6789/0 conn(0x7fdabc0a4c20 legacy=0x7fdabc1380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:55.885 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 10 monclient: _finish_hunting 0 2026-02-17T12:04:55.885 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 1 monclient: found mon.noname-b 2026-02-17T12:04:55.885 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:55.885 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:04:55.885 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 1 -- 10.20.193.77:0/3828834471 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdabc09d3b0 con 0x7fdabc0a5070 2026-02-17T12:04:55.891 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.879+0000 7fdac0a4e640 1 -- 10.20.193.77:0/3828834471 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a5070 msgr2=0x7fdabc138800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:55.891 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac0a4e640 1 --2- 10.20.193.77:0/3828834471 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a5070 0x7fdabc138800 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009e50 tx=0x7fdab001c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb687d1b843d000e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:55.891 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabaffd640 1 -- 10.20.193.77:0/3828834471 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab00a5660 con 0x7fdabc0a5070 2026-02-17T12:04:55.891 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.891 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:04:55.891 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabaffd640 10 monclient: dump: 2026-02-17T12:04:55.891 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:04:55.892 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.892 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.892 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.892 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.892 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:04:55.892 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.892 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.892 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.892 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:04:55.892 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabaffd640 10 monclient: _finish_auth 0 2026-02-17T12:04:55.892 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabaffd640 10 monclient: _check_auth_tickets 2026-02-17T12:04:55.892 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:55.893 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabaffd640 1 -- 10.20.193.77:0/3828834471 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab00a5800 con 0x7fdabc0a5070 2026-02-17T12:04:55.893 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:55.893 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabaffd640 1 -- 10.20.193.77:0/3828834471 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab00a5bd0 con 0x7fdabc0a5070 2026-02-17T12:04:55.893 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.893 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:55.893 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabaffd640 10 monclient: dump: 2026-02-17T12:04:55.893 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:04:55.893 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.893 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.893 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.893 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.894 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:04:55.894 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.894 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.894 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.894 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:04:55.894 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 5 monclient: authenticate success, global_id 4145 2026-02-17T12:04:55.894 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:55.894 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 4 set_mon_vals no callback set 2026-02-17T12:04:55.894 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient: shutdown 2026-02-17T12:04:55.894 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:55.894 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 -- 10.20.193.77:0/3828834471 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a5070 msgr2=0x7fdabc138800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 --2- 10.20.193.77:0/3828834471 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a5070 0x7fdabc138800 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009e50 tx=0x7fdab001c910 comp rx=0 tx=0).stop 2026-02-17T12:04:55.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 -- 10.20.193.77:0/3828834471 shutdown_connections 2026-02-17T12:04:55.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 --2- 10.20.193.77:0/3828834471 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a5070 0x7fdabc138800 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 --2- 10.20.193.77:0/3828834471 >> v2:10.20.193.119:3300/0 conn(0x7fdabc09be20 0x7fdabc134e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 -- 10.20.193.77:0/3828834471 >> 10.20.193.77:0/3828834471 conn(0x7fdabc074ba0 msgr2=0x7fdabc0aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:55.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 -- 10.20.193.77:0/3828834471 shutdown_connections 2026-02-17T12:04:55.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 -- 10.20.193.77:0/3828834471 wait complete. 2026-02-17T12:04:55.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient: build_initial_monmap 2026-02-17T12:04:55.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient: monmap: 2026-02-17T12:04:55.895 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:04:55.895 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:55.895 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:04:55.895 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:04:55.896 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:55.896 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:04:55.896 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:04:55.896 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:04:55.896 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:04:55.896 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:04:55.896 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 Processor -- start 2026-02-17T12:04:55.896 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 -- start start 2026-02-17T12:04:55.896 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient: init 2026-02-17T12:04:55.896 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:55.896 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:04:55.896 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fdabc09be20 0x7fdabc0a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient(hunting): picked mon.noname-a con 0x7fdabc09be20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:04:55.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a4c20 0x7fdabc0a3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient(hunting): picked mon.noname-c con 0x7fdabc0a4c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:55.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdabc0a5070 0x7fdabc1d2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:55.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient(hunting): picked mon.noname-b con 0x7fdabc0a5070 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:04:55.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc138f50 con 0x7fdabc09be20 2026-02-17T12:04:55.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc142ec0 con 0x7fdabc0a5070 2026-02-17T12:04:55.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:55.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdabc143040 con 0x7fdabc0a4c20 2026-02-17T12:04:55.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:55.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac24d8640 10 monclient(hunting): authenticate will time out at 547.561503s 2026-02-17T12:04:55.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabbfff640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fdabc09be20 0x7fdabc0a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a4c20 0x7fdabc0a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a4c20 0x7fdabc0a3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:43962/0 (socket says 10.20.193.77:43962) 2026-02-17T12:04:55.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 1 -- 10.20.193.77:0/3692493 learned_addr learned my addr 10.20.193.77:0/3692493 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:04:55.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabbfff640 10 monclient(hunting): get_auth_request con 0x7fdabc09be20 auth_method 0 2026-02-17T12:04:55.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 10 monclient(hunting): get_auth_request con 0x7fdabc0a4c20 auth_method 0 2026-02-17T12:04:55.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.899 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:55.899 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:55.899 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:55.899 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:55.899 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:55.899 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac0a4e640 1 --2- 10.20.193.77:0/3692493 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdabc0a5070 0x7fdabc1d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:55.899 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:55.899 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac0a4e640 10 monclient(hunting): get_auth_request con 0x7fdabc0a5070 auth_method 0 2026-02-17T12:04:55.899 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac0a4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:55.899 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac0a4e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:55.899 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdac0a4e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:55.899 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 10 monclient(hunting): handle_auth_done global_id 4148 payload 824 2026-02-17T12:04:55.899 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 1 -- 10.20.193.77:0/3692493 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdabc0a5070 msgr2=0x7fdabc1d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 1 --2- 10.20.193.77:0/3692493 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdabc0a5070 0x7fdabc1d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 1 -- 10.20.193.77:0/3692493 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fdabc09be20 msgr2=0x7fdabc0a2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 1 --2- 10.20.193.77:0/3692493 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fdabc09be20 0x7fdabc0a2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:04:55.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 1 monclient: found mon.noname-c 2026-02-17T12:04:55.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:55.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:04:55.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 1 -- 10.20.193.77:0/3692493 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdabc13b030 con 0x7fdabc0a4c20 2026-02-17T12:04:55.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 1 -- 10.20.193.77:0/3692493 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a4c20 msgr2=0x7fdabc0a3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:55.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.883+0000 7fdabb7fe640 1 --2- 10.20.193.77:0/3692493 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a4c20 0x7fdabc0a3240 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00c580 tx=0x7fdaac00ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:55.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 1 -- 10.20.193.77:0/3692493 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac016020 con 0x7fdabc0a4c20 2026-02-17T12:04:55.901 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.901 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:04:55.901 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 10 monclient: dump: 2026-02-17T12:04:55.901 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:04:55.901 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.901 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.901 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.901 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.901 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:04:55.901 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.901 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.901 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.901 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:04:55.902 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 10 monclient: _finish_auth 0 2026-02-17T12:04:55.902 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:04:55.902 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:55.902 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 1 -- 10.20.193.77:0/3692493 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaac012a60 con 0x7fdabc0a4c20 2026-02-17T12:04:55.902 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:55.902 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 1 -- 10.20.193.77:0/3692493 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac012e50 con 0x7fdabc0a4c20 2026-02-17T12:04:55.902 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:55.902 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:04:55.902 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 10 monclient: dump: 2026-02-17T12:04:55.902 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:04:55.902 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:55.902 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.902 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:55.903 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:55.903 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:04:55.903 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:55.903 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:55.903 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:55.903 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:04:55.903 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdaba7fc640 4 set_mon_vals no callback set 2026-02-17T12:04:55.903 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdac24d8640 5 monclient: authenticate success, global_id 4148 2026-02-17T12:04:55.903 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdac24d8640 10 monclient: _renew_subs 2026-02-17T12:04:55.903 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdac24d8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:04:55.903 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdac24d8640 1 -- 10.20.193.77:0/3692493 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdabc0a8a60 con 0x7fdabc0a4c20 2026-02-17T12:04:55.903 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdac24d8640 10 monclient: _renew_subs 2026-02-17T12:04:55.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdac24d8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:04:55.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdac24d8640 1 -- 10.20.193.77:0/3692493 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdabc13ad50 con 0x7fdabc0a4c20 2026-02-17T12:04:55.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 1 -- 10.20.193.77:0/3692493 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fdaac01b790 con 0x7fdabc0a4c20 2026-02-17T12:04:55.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 1 -- 10.20.193.77:0/3692493 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fdaac01ad50 con 0x7fdabc0a4c20 2026-02-17T12:04:55.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdac24d8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:55.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdac24d8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:55.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdac24d8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:04:55.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdac24d8640 1 -- 10.20.193.77:0/3692493 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdabc134e20 con 0x7fdabc0a4c20 2026-02-17T12:04:55.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 1 -- 10.20.193.77:0/3692493 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fdaac020020 con 0x7fdabc0a4c20 2026-02-17T12:04:55.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:55.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.887+0000 7fdab8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:55.915 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:04:55.915 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:04:55.915 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:04:55.915 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 1 -- 10.20.193.77:0/3692493 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdabc06f570 con 0x7fdabc0a4c20 2026-02-17T12:04:55.915 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdab8ff9640 1 -- 10.20.193.77:0/3692493 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (secure 0 0 0) 0x7fdaac011430 con 0x7fdabc0a4c20 2026-02-17T12:04:55.915 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdab8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:04:55.915 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdab8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:55.916 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:04:55.916 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":8,"fsid":"093d53f2-7cd0-4506-a27d-4c950e190615","created":"2026-02-17T12:04:53.336611+0000","modified":"2026-02-17T12:04:55.265712+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T12:04:55.265712+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ad6780fd-cb0e-481f-8816-a32e3434b102","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a82a493e-88de-4b65-ab23-41b52ffb6b61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"02ae9c66-fa9e-46d2-8be5-ba695ba4763b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fe40e683-451d-4e8a-94f4-69ace432df28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e6fc84bb-bd81-49d5-8cfd-b4ab0468d8dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"400ef2a1-c8ee-4376-b3d9-588e2a34ad9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:04:55.917 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 10 monclient: shutdown 2026-02-17T12:04:55.917 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:55.917 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 1 -- 10.20.193.77:0/3692493 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a4c20 msgr2=0x7fdabc0a3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:55.917 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 1 --2- 10.20.193.77:0/3692493 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a4c20 0x7fdabc0a3240 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00c580 tx=0x7fdaac00ca40 comp rx=0 tx=0).stop 2026-02-17T12:04:55.917 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 1 -- 10.20.193.77:0/3692493 shutdown_connections 2026-02-17T12:04:55.917 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 1 --2- 10.20.193.77:0/3692493 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fdabc0a5070 0x7fdabc1d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.917 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 1 --2- 10.20.193.77:0/3692493 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fdabc0a4c20 0x7fdabc0a3240 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.917 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 1 --2- 10.20.193.77:0/3692493 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fdabc09be20 0x7fdabc0a2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:55.918 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 1 -- 10.20.193.77:0/3692493 >> 10.20.193.77:0/3692493 conn(0x7fdabc074ba0 msgr2=0x7fdabc137db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:55.918 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 1 -- 10.20.193.77:0/3692493 shutdown_connections 2026-02-17T12:04:55.918 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:04:55.915+0000 7fdac24d8640 1 -- 10.20.193.77:0/3692493 wait complete. 2026-02-17T12:04:55.924 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T12:04:55.925 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T12:04:55.968 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:55.963+0000 7f81fc7cf280 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T12:04:55.992 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:55.987+0000 7f81fc7cf280 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T12:04:56.019 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:56.015+0000 7f81fc7cf280 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T12:04:56.046 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:56.043+0000 7f81fc7cf280 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T12:04:56.171 INFO:tasks.ceph.mgr.x.trial119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T12:04:56.171 INFO:tasks.ceph.mgr.x.trial119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T12:04:56.171 INFO:tasks.ceph.mgr.x.trial119.stderr: from numpy import show_config as show_numpy_config 2026-02-17T12:04:56.178 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:56.175+0000 7f81fc7cf280 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T12:04:56.204 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:56.199+0000 7f81fc7cf280 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T12:04:56.243 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:56.239+0000 7f81fc7cf280 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T12:04:56.529 DEBUG:teuthology.orchestra.run.trial077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T12:04:56.585 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 10 monclient: get_monmap_and_config 2026-02-17T12:04:56.586 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 10 monclient: build_initial_monmap 2026-02-17T12:04:56.586 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 10 monclient: monmap: 2026-02-17T12:04:56.586 INFO:teuthology.misc.health.trial077.stderr:epoch 0 2026-02-17T12:04:56.586 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:56.586 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:04:56.588106+0000 2026-02-17T12:04:56.586 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:04:56.588106+0000 2026-02-17T12:04:56.586 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:56.586 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:04:56.586 INFO:teuthology.misc.health.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:04:56.586 INFO:teuthology.misc.health.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:04:56.586 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:04:56.587 INFO:teuthology.misc.health.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:04:56.587 INFO:teuthology.misc.health.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:04:56.587 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:04:56.587 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 1 Processor -- start 2026-02-17T12:04:56.587 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 1 -- start start 2026-02-17T12:04:56.587 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 10 monclient: init 2026-02-17T12:04:56.593 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:56.593 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 10 monclient: _add_conns ranks=[3,1,4,2,0] 2026-02-17T12:04:56.593 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7eff700a7740 0x7eff70135070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:56.593 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 10 monclient(hunting): picked mon.noname-a con 0x7eff700a7740 addr v2:10.20.193.77:3300/0 2026-02-17T12:04:56.594 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7eff700a4b80 addr v1:10.20.193.119:6789/0 2026-02-17T12:04:56.594 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7eff700a4fb0 0x7eff701386d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:56.594 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 10 monclient(hunting): picked mon.noname-c con 0x7eff700a4fb0 addr v2:10.20.193.119:3300/0 2026-02-17T12:04:56.594 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7009d310 con 0x7eff700a4b80 2026-02-17T12:04:56.594 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:56.594 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7eff700a7b20 con 0x7eff700a7740 2026-02-17T12:04:56.594 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:56.594 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7eff7009d5f0 con 0x7eff700a4fb0 2026-02-17T12:04:56.594 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:56.595 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff769cc640 10 monclient(hunting): authenticate will time out at 548.263706s 2026-02-17T12:04:56.595 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff6ffff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7eff700a7740 0x7eff70135070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:56.595 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff6ffff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7eff700a7740 0x7eff70135070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:48278/0 (socket says 10.20.193.77:48278) 2026-02-17T12:04:56.595 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff6ffff640 1 -- 10.20.193.77:0/2095479054 learned_addr learned my addr 10.20.193.77:0/2095479054 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:04:56.595 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff6ffff640 10 monclient(hunting): get_auth_request con 0x7eff700a7740 auth_method 0 2026-02-17T12:04:56.595 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff6ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:56.595 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff6ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:56.595 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff6ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:56.595 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff6ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:56.595 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff6ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:56.595 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff74f42640 1 --2- 10.20.193.77:0/2095479054 >> v2:10.20.193.119:3300/0 conn(0x7eff700a4fb0 0x7eff701386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:56.595 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff6ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:56.596 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff74f42640 10 monclient(hunting): get_auth_request con 0x7eff700a4fb0 auth_method 0 2026-02-17T12:04:56.596 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff74f42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:56.596 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff74f42640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:56.596 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.583+0000 7eff74f42640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:56.596 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6ffff640 10 monclient(hunting): handle_auth_done global_id 4167 payload 274 2026-02-17T12:04:56.596 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6ffff640 1 -- 10.20.193.77:0/2095479054 >> v2:10.20.193.119:3300/0 conn(0x7eff700a4fb0 msgr2=0x7eff701386d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:56.596 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6ffff640 1 --2- 10.20.193.77:0/2095479054 >> v2:10.20.193.119:3300/0 conn(0x7eff700a4fb0 0x7eff701386d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:56.596 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6ffff640 1 -- 10.20.193.77:0/2095479054 >> v1:10.20.193.119:6789/0 conn(0x7eff700a4b80 legacy=0x7eff70137fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:04:56.596 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:04:56.596 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6ffff640 1 monclient: found mon.noname-a 2026-02-17T12:04:56.596 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:56.596 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:04:56.597 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6ffff640 1 -- 10.20.193.77:0/2095479054 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff701355b0 con 0x7eff700a7740 2026-02-17T12:04:56.597 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6ffff640 1 -- 10.20.193.77:0/2095479054 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7eff700a7740 msgr2=0x7eff70135070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:56.597 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6ffff640 1 --2- 10.20.193.77:0/2095479054 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7eff700a7740 0x7eff70135070 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7eff700a8810 tx=0x7eff5c01c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40edc52b70a148a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:56.597 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6effd640 1 -- 10.20.193.77:0/2095479054 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0b0070 con 0x7eff700a7740 2026-02-17T12:04:56.597 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:56.597 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:56.597 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6effd640 10 monclient: dump: 2026-02-17T12:04:56.597 INFO:teuthology.misc.health.trial077.stderr:epoch 1 2026-02-17T12:04:56.597 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:56.597 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:56.597 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:56.597 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:56.598 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:04:56.598 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:56.598 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:56.598 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:56.598 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:04:56.598 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6effd640 10 monclient: _finish_auth 0 2026-02-17T12:04:56.598 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6effd640 10 monclient: _check_auth_tickets 2026-02-17T12:04:56.598 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:56.598 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6effd640 1 -- 10.20.193.77:0/2095479054 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff5c004230 con 0x7eff700a7740 2026-02-17T12:04:56.598 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:56.598 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6effd640 1 -- 10.20.193.77:0/2095479054 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c003720 con 0x7eff700a7740 2026-02-17T12:04:56.598 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff769cc640 5 monclient: authenticate success, global_id 4167 2026-02-17T12:04:56.599 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff769cc640 10 monclient: get_monmap_and_config success 2026-02-17T12:04:56.599 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff769cc640 4 set_mon_vals no callback set 2026-02-17T12:04:56.599 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:56.599 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:56.599 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff6effd640 10 monclient: dump: 2026-02-17T12:04:56.599 INFO:teuthology.misc.health.trial077.stderr:epoch 1 2026-02-17T12:04:56.599 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:56.599 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:56.599 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:56.599 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:56.599 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:04:56.599 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:56.600 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:56.600 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:56.600 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:04:56.600 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff769cc640 10 monclient: shutdown 2026-02-17T12:04:56.600 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff769cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:56.600 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff769cc640 1 -- 10.20.193.77:0/2095479054 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7eff700a7740 msgr2=0x7eff70135070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:56.600 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff769cc640 1 --2- 10.20.193.77:0/2095479054 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7eff700a7740 0x7eff70135070 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7eff700a8810 tx=0x7eff5c01c590 comp rx=0 tx=0).stop 2026-02-17T12:04:56.600 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff769cc640 1 -- 10.20.193.77:0/2095479054 shutdown_connections 2026-02-17T12:04:56.601 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff769cc640 1 --2- 10.20.193.77:0/2095479054 >> v2:10.20.193.119:3300/0 conn(0x7eff700a4fb0 0x7eff701386d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:56.601 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff769cc640 1 --2- 10.20.193.77:0/2095479054 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7eff700a7740 0x7eff70135070 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:56.601 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff769cc640 1 -- 10.20.193.77:0/2095479054 >> 10.20.193.77:0/2095479054 conn(0x7eff700aac50 msgr2=0x7eff700ab060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:56.601 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff769cc640 1 -- 10.20.193.77:0/2095479054 shutdown_connections 2026-02-17T12:04:56.601 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.587+0000 7eff769cc640 1 -- 10.20.193.77:0/2095479054 wait complete. 2026-02-17T12:04:56.601 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient: build_initial_monmap 2026-02-17T12:04:56.602 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient: monmap: 2026-02-17T12:04:56.602 INFO:teuthology.misc.health.trial077.stderr:epoch 0 2026-02-17T12:04:56.602 INFO:teuthology.misc.health.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:04:56.602 INFO:teuthology.misc.health.trial077.stderr:last_changed 0.000000 2026-02-17T12:04:56.602 INFO:teuthology.misc.health.trial077.stderr:created 0.000000 2026-02-17T12:04:56.602 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:04:56.603 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:04:56.603 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:04:56.603 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:04:56.603 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:04:56.603 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:04:56.603 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 1 Processor -- start 2026-02-17T12:04:56.603 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 1 -- start start 2026-02-17T12:04:56.604 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient: init 2026-02-17T12:04:56.604 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient: _reopen_session rank -1 2026-02-17T12:04:56.604 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:04:56.604 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7eff700a4b80 0x7eff701d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:56.604 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient(hunting): picked mon.noname-a con 0x7eff700a4b80 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:04:56.604 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7eff700a4fb0 0x7eff700a3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:56.605 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient(hunting): picked mon.noname-c con 0x7eff700a4fb0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:04:56.605 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7eff700a7740 0x7eff7009ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:56.605 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient(hunting): picked mon.noname-b con 0x7eff700a7740 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:04:56.605 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:56.605 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7eff70138e20 con 0x7eff700a4b80 2026-02-17T12:04:56.605 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:56.606 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7eff70134c90 con 0x7eff700a7740 2026-02-17T12:04:56.606 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:04:56.606 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7eff70142d90 con 0x7eff700a4fb0 2026-02-17T12:04:56.606 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient(hunting): _renew_subs 2026-02-17T12:04:56.606 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient(hunting): authenticate will time out at 548.269121s 2026-02-17T12:04:56.606 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7eff700a4b80 0x7eff701d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:56.607 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7eff700a4b80 0x7eff701d1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:48280/0 (socket says 10.20.193.77:48280) 2026-02-17T12:04:56.607 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 1 -- 10.20.193.77:0/3138281450 learned_addr learned my addr 10.20.193.77:0/3138281450 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:04:56.607 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6f7fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7eff700a4fb0 0x7eff700a3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:56.607 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 10 monclient(hunting): get_auth_request con 0x7eff700a4b80 auth_method 0 2026-02-17T12:04:56.607 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:56.607 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:56.607 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:56.608 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6f7fe640 10 monclient(hunting): get_auth_request con 0x7eff700a4fb0 auth_method 0 2026-02-17T12:04:56.608 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:56.608 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:56.608 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:56.608 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:56.608 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:56.609 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:56.609 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff74f42640 1 --2- 10.20.193.77:0/3138281450 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7eff700a7740 0x7eff7009ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:04:56.609 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff74f42640 10 monclient(hunting): get_auth_request con 0x7eff700a7740 auth_method 0 2026-02-17T12:04:56.609 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff74f42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:04:56.609 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff74f42640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:04:56.610 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff74f42640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:04:56.610 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:04:56.610 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:04:56.610 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:04:56.610 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 10 monclient(hunting): handle_auth_done global_id 4170 payload 824 2026-02-17T12:04:56.610 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 1 -- 10.20.193.77:0/3138281450 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7eff700a4fb0 msgr2=0x7eff700a3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:56.611 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 1 --2- 10.20.193.77:0/3138281450 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7eff700a4fb0 0x7eff700a3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:56.611 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 1 -- 10.20.193.77:0/3138281450 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7eff700a7740 msgr2=0x7eff7009ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:56.611 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 1 --2- 10.20.193.77:0/3138281450 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7eff700a7740 0x7eff7009ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:56.611 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:04:56.611 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 1 monclient: found mon.noname-a 2026-02-17T12:04:56.611 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:04:56.611 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:04:56.612 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 1 -- 10.20.193.77:0/3138281450 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff70132b60 con 0x7eff700a4b80 2026-02-17T12:04:56.615 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 1 -- 10.20.193.77:0/3138281450 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7eff700a4b80 msgr2=0x7eff701d1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:04:56.615 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6ffff640 1 --2- 10.20.193.77:0/3138281450 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7eff700a4b80 0x7eff701d1ee0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7eff5c01a1c0 tx=0x7eff5c019330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:04:56.616 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6cff9640 1 -- 10.20.193.77:0/3138281450 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0bb070 con 0x7eff700a4b80 2026-02-17T12:04:56.616 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:56.616 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:04:56.616 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6cff9640 10 monclient: dump: 2026-02-17T12:04:56.616 INFO:teuthology.misc.health.trial077.stderr:epoch 1 2026-02-17T12:04:56.617 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:56.617 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:56.617 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:56.617 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:56.617 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:04:56.617 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:56.618 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:56.618 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:56.618 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:04:56.618 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6cff9640 10 monclient: _finish_auth 0 2026-02-17T12:04:56.618 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6cff9640 10 monclient: _check_auth_tickets 2026-02-17T12:04:56.618 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:04:56.619 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6cff9640 1 -- 10.20.193.77:0/3138281450 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff5c003c30 con 0x7eff700a4b80 2026-02-17T12:04:56.619 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:04:56.619 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6cff9640 1 -- 10.20.193.77:0/3138281450 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0b0040 con 0x7eff700a4b80 2026-02-17T12:04:56.619 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:04:56.619 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:04:56.619 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6e7fc640 4 set_mon_vals no callback set 2026-02-17T12:04:56.620 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff6cff9640 10 monclient: dump: 2026-02-17T12:04:56.620 INFO:teuthology.misc.health.trial077.stderr:epoch 1 2026-02-17T12:04:56.620 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:04:56.620 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:56.620 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:04:56.620 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:04:56.621 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:04:56.621 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:04:56.621 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:04:56.621 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:04:56.621 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:04:56.621 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 5 monclient: authenticate success, global_id 4170 2026-02-17T12:04:56.621 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient: _renew_subs 2026-02-17T12:04:56.621 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:04:56.622 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 1 -- 10.20.193.77:0/3138281450 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff700a06d0 con 0x7eff700a4b80 2026-02-17T12:04:56.622 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient: _renew_subs 2026-02-17T12:04:56.622 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:04:56.622 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.591+0000 7eff769cc640 1 -- 10.20.193.77:0/3138281450 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff700a2a30 con 0x7eff700a4b80 2026-02-17T12:04:56.622 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.595+0000 7eff769cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:56.622 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.595+0000 7eff769cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:56.623 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.595+0000 7eff769cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:04:56.623 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.595+0000 7eff6cff9640 1 -- 10.20.193.77:0/3138281450 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 2) ==== 47202+0+0 (secure 0 0 0) 0x7eff5c0b6470 con 0x7eff700a4b80 2026-02-17T12:04:56.623 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.595+0000 7eff769cc640 1 -- 10.20.193.77:0/3138281450 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff70135070 con 0x7eff700a4b80 2026-02-17T12:04:56.623 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.595+0000 7eff6cff9640 1 -- 10.20.193.77:0/3138281450 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7eff5c0e6940 con 0x7eff700a4b80 2026-02-17T12:04:56.623 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.595+0000 7eff6cff9640 1 -- 10.20.193.77:0/3138281450 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7eff5c016210 con 0x7eff700a4b80 2026-02-17T12:04:56.623 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.595+0000 7eff6cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:04:56.623 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.595+0000 7eff6cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:04:56.625 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.623+0000 7eff769cc640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:04:56.625 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.623+0000 7eff769cc640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:04:56.625 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.623+0000 7eff769cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:04:56.625 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.623+0000 7eff769cc640 1 -- 10.20.193.77:0/3138281450 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff700a2570 con 0x7eff700a4b80 2026-02-17T12:04:56.625 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:56.623+0000 7eff6ffff640 1 --2- 10.20.193.77:0/3138281450 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7eff700a4b80 0x7eff701d1ee0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7eff5c01a1c0 tx=0x7eff5c019330 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7eff5c0bedb0 mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) 2026-02-17T12:04:57.268 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff6cff9640 1 -- 10.20.193.77:0/3138281450 <== mon.0 v2:10.20.193.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (secure 0 0 0) 0x7eff5c0bedb0 con 0x7eff700a4b80 2026-02-17T12:04:57.268 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff6cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:04:57.268 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff6cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:04:57.269 INFO:teuthology.misc.health.trial077.stdout: 2026-02-17T12:04:57.269 INFO:teuthology.misc.health.trial077.stdout:{"epoch":8,"fsid":"093d53f2-7cd0-4506-a27d-4c950e190615","created":"2026-02-17T12:04:53.336611+0000","modified":"2026-02-17T12:04:55.265712+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T12:04:55.265712+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ad6780fd-cb0e-481f-8816-a32e3434b102","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a82a493e-88de-4b65-ab23-41b52ffb6b61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"02ae9c66-fa9e-46d2-8be5-ba695ba4763b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fe40e683-451d-4e8a-94f4-69ace432df28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e6fc84bb-bd81-49d5-8cfd-b4ab0468d8dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"400ef2a1-c8ee-4376-b3d9-588e2a34ad9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:04:57.270 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff769cc640 10 monclient: shutdown 2026-02-17T12:04:57.270 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff769cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:04:57.270 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff769cc640 1 -- 10.20.193.77:0/3138281450 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7eff700a4b80 msgr2=0x7eff701d1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:04:57.271 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff769cc640 1 --2- 10.20.193.77:0/3138281450 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7eff700a4b80 0x7eff701d1ee0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7eff5c01a1c0 tx=0x7eff5c019330 comp rx=0 tx=0).stop 2026-02-17T12:04:57.271 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff6cff9640 1 -- 10.20.193.77:0/3138281450 <== mon.0 v2:10.20.193.77:3300/0 8 ==== mgrmap(e 3) ==== 47294+0+0 (unknown 0 0 0) 0x7eff5c0b6790 con 0x7eff700a4b80 2026-02-17T12:04:57.271 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff769cc640 1 -- 10.20.193.77:0/3138281450 shutdown_connections 2026-02-17T12:04:57.271 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff769cc640 1 --2- 10.20.193.77:0/3138281450 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7eff700a7740 0x7eff7009ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:57.271 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff769cc640 1 --2- 10.20.193.77:0/3138281450 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7eff700a4fb0 0x7eff700a3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:57.271 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff769cc640 1 --2- 10.20.193.77:0/3138281450 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7eff700a4b80 0x7eff701d1ee0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:57.271 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff769cc640 1 -- 10.20.193.77:0/3138281450 >> 10.20.193.77:0/3138281450 conn(0x7eff700aac50 msgr2=0x7eff700a8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:04:57.271 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff6cff9640 1 --2- 10.20.193.77:0/3138281450 >> v2:10.20.193.119:6800/4127986552 conn(0x7eff4003b5e0 0x7eff4003d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:04:57.271 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff769cc640 1 -- 10.20.193.77:0/3138281450 shutdown_connections 2026-02-17T12:04:57.271 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff769cc640 1 --2- 10.20.193.77:0/3138281450 >> v2:10.20.193.119:6800/4127986552 conn(0x7eff4003b5e0 0x7eff4003d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:04:57.271 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:04:57.267+0000 7eff769cc640 1 -- 10.20.193.77:0/3138281450 wait complete. 2026-02-17T12:04:57.278 DEBUG:teuthology.misc:0 of 6 OSDs are up 2026-02-17T12:04:57.279 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:57.275+0000 7f811b221640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-17T12:04:57.283 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-17T12:04:57.279+0000 7f811b221640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-17T12:04:57.343 INFO:tasks.ceph.osd.0.trial077.stderr:2026-02-17T12:04:57.343+0000 7fd8e7a728c0 -1 Falling back to public interface 2026-02-17T12:04:57.343 INFO:tasks.ceph.osd.1.trial077.stderr:2026-02-17T12:04:57.343+0000 7f14d61ed8c0 -1 Falling back to public interface 2026-02-17T12:04:57.474 INFO:tasks.ceph.osd.3.trial119.stderr:2026-02-17T12:04:57.471+0000 7f16c4e4e8c0 -1 Falling back to public interface 2026-02-17T12:04:57.527 INFO:tasks.ceph.osd.2.trial077.stderr:2026-02-17T12:04:57.527+0000 7fbf800028c0 -1 Falling back to public interface 2026-02-17T12:04:57.658 INFO:tasks.ceph.osd.4.trial119.stderr:2026-02-17T12:04:57.655+0000 7ffaf990e8c0 -1 Falling back to public interface 2026-02-17T12:04:57.901 INFO:tasks.ceph.osd.5.trial119.stderr:2026-02-17T12:04:57.899+0000 7f35cd8258c0 -1 Falling back to public interface 2026-02-17T12:05:01.257 INFO:tasks.ceph.osd.0.trial077.stderr:2026-02-17T12:05:01.255+0000 7fd8e7a728c0 -1 osd.0 0 log_to_monitors true 2026-02-17T12:05:01.277 INFO:tasks.ceph.osd.1.trial077.stderr:2026-02-17T12:05:01.275+0000 7f14d61ed8c0 -1 osd.1 0 log_to_monitors true 2026-02-17T12:05:01.347 INFO:tasks.ceph.osd.3.trial119.stderr:2026-02-17T12:05:01.343+0000 7f16c4e4e8c0 -1 osd.3 0 log_to_monitors true 2026-02-17T12:05:01.436 INFO:tasks.ceph.osd.2.trial077.stderr:2026-02-17T12:05:01.435+0000 7fbf800028c0 -1 osd.2 0 log_to_monitors true 2026-02-17T12:05:02.022 INFO:tasks.ceph.osd.4.trial119.stderr:2026-02-17T12:05:02.019+0000 7ffaf990e8c0 -1 osd.4 0 log_to_monitors true 2026-02-17T12:05:02.276 INFO:tasks.ceph.osd.5.trial119.stderr:2026-02-17T12:05:02.271+0000 7f35cd8258c0 -1 osd.5 0 log_to_monitors true 2026-02-17T12:05:02.697 INFO:tasks.ceph.osd.0.trial077.stderr:2026-02-17T12:05:02.695+0000 7fd8e3a1b640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T12:05:02.700 INFO:tasks.ceph.osd.0.trial077.stderr:2026-02-17T12:05:02.699+0000 7fd8db84e640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:05:03.282 INFO:tasks.ceph.osd.3.trial119.stderr:2026-02-17T12:05:03.279+0000 7f16c0df7640 -1 osd.3 0 waiting for initial osdmap 2026-02-17T12:05:03.285 INFO:tasks.ceph.osd.3.trial119.stderr:2026-02-17T12:05:03.283+0000 7f16bcc32640 -1 osd.3 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:05:03.677 INFO:tasks.ceph.osd.4.trial119.stderr:2026-02-17T12:05:03.675+0000 7ffaf58b7640 -1 osd.4 0 waiting for initial osdmap 2026-02-17T12:05:03.680 INFO:tasks.ceph.osd.4.trial119.stderr:2026-02-17T12:05:03.675+0000 7ffaed6ea640 -1 osd.4 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:05:03.696 INFO:tasks.ceph.osd.1.trial077.stderr:2026-02-17T12:05:03.695+0000 7f14d2196640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T12:05:03.698 INFO:tasks.ceph.osd.1.trial077.stderr:2026-02-17T12:05:03.699+0000 7f14c9fc9640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:05:03.708 INFO:tasks.ceph.osd.2.trial077.stderr:2026-02-17T12:05:03.707+0000 7fbf7bfab640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T12:05:03.711 INFO:tasks.ceph.osd.2.trial077.stderr:2026-02-17T12:05:03.711+0000 7fbf73dde640 -1 osd.2 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:05:03.883 DEBUG:teuthology.orchestra.run.trial077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 10 monclient: get_monmap_and_config 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 10 monclient: build_initial_monmap 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 10 monclient: monmap: 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:epoch 0 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:05:03.943174+0000 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:05:03.943174+0000 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 1 Processor -- start 2026-02-17T12:05:03.940 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 1 -- start start 2026-02-17T12:05:03.941 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 10 monclient: init 2026-02-17T12:05:03.941 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:03.941 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2026-02-17T12:05:03.941 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fa67c0a5380 0x7fa67c073d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:03.941 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 10 monclient(hunting): picked mon.noname-a con 0x7fa67c0a5380 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:03.941 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fa67c0a5760 0x7fa67c0a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:03.941 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 10 monclient(hunting): picked mon.noname-c con 0x7fa67c0a5760 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa67c138140 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c073640 con 0x7fa67c138140 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa67c09df40 con 0x7fa67c0a5380 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa67c09e180 con 0x7fa67c0a5760 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa682801640 10 monclient(hunting): authenticate will time out at 555.618970s 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fa67c0a5380 0x7fa67c073d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fa67c0a5380 0x7fa67c073d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:54406/0 (socket says 10.20.193.77:54406) 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 1 -- 10.20.193.77:0/2035610503 learned_addr learned my addr 10.20.193.77:0/2035610503 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 10 monclient(hunting): get_auth_request con 0x7fa67c0a5380 auth_method 0 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa680ffe640 1 --2- 10.20.193.77:0/2035610503 >> v2:10.20.193.119:3300/0 conn(0x7fa67c0a5760 0x7fa67c0a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa680ffe640 10 monclient(hunting): get_auth_request con 0x7fa67c0a5760 auth_method 0 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa680ffe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa680ffe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa680ffe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 10 monclient(hunting): handle_auth_done global_id 4191 payload 274 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 1 -- 10.20.193.77:0/2035610503 >> v2:10.20.193.119:3300/0 conn(0x7fa67c0a5760 msgr2=0x7fa67c0a5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 1 --2- 10.20.193.77:0/2035610503 >> v2:10.20.193.119:3300/0 conn(0x7fa67c0a5760 0x7fa67c0a5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 1 -- 10.20.193.77:0/2035610503 >> v1:10.20.193.77:6789/0 conn(0x7fa67c138140 legacy=0x7fa67c138550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 1 monclient: found mon.noname-a 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:03.942 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.939+0000 7fa6817ff640 1 -- 10.20.193.77:0/2035610503 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c073360 con 0x7fa67c0a5380 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa6817ff640 1 -- 10.20.193.77:0/2035610503 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa67c0a5380 msgr2=0x7fa67c073d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa6817ff640 1 --2- 10.20.193.77:0/2035610503 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa67c0a5380 0x7fa67c073d40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa67c09d880 tx=0x7fa66c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ca944a2c731f8e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa66bfff640 1 -- 10.20.193.77:0/2035610503 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c004230 con 0x7fa67c0a5380 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa66bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa66bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa66bfff640 10 monclient: dump: 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:epoch 1 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:03.945 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa66bfff640 10 monclient: _finish_auth 0 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa66bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa66bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa66bfff640 1 -- 10.20.193.77:0/2035610503 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66c0043d0 con 0x7fa67c0a5380 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa66bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa66bfff640 1 -- 10.20.193.77:0/2035610503 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c003720 con 0x7fa67c0a5380 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa682801640 5 monclient: authenticate success, global_id 4191 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa66bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa66bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa66bfff640 10 monclient: dump: 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:epoch 1 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa682801640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa682801640 4 set_mon_vals no callback set 2026-02-17T12:05:03.946 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa682801640 10 monclient: shutdown 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa682801640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa682801640 1 -- 10.20.193.77:0/2035610503 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa67c0a5380 msgr2=0x7fa67c073d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa682801640 1 --2- 10.20.193.77:0/2035610503 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa67c0a5380 0x7fa67c073d40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa67c09d880 tx=0x7fa66c01c000 comp rx=0 tx=0).stop 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa682801640 1 -- 10.20.193.77:0/2035610503 shutdown_connections 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa682801640 1 --2- 10.20.193.77:0/2035610503 >> v2:10.20.193.119:3300/0 conn(0x7fa67c0a5760 0x7fa67c0a5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa682801640 1 --2- 10.20.193.77:0/2035610503 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa67c0a5380 0x7fa67c073d40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa682801640 1 -- 10.20.193.77:0/2035610503 >> 10.20.193.77:0/2035610503 conn(0x7fa67c0aab50 msgr2=0x7fa67c0aaf60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa682801640 1 -- 10.20.193.77:0/2035610503 shutdown_connections 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.943+0000 7fa682801640 1 -- 10.20.193.77:0/2035610503 wait complete. 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient: build_initial_monmap 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient: monmap: 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:epoch 0 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:created 0.000000 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 1 Processor -- start 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 1 -- start start 2026-02-17T12:05:03.947 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient: init 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa67c0a5380 0x7fa67c1d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient(hunting): picked mon.noname-a con 0x7fa67c0a5380 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa67c0a5760 0x7fa67c137250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient(hunting): picked mon.noname-c con 0x7fa67c0a5760 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa67c138140 0x7fa67c13d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient(hunting): picked mon.noname-b con 0x7fa67c138140 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c1439f0 con 0x7fa67c0a5380 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c143870 con 0x7fa67c138140 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa67c143b70 con 0x7fa67c0a5760 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient(hunting): authenticate will time out at 555.624906s 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa67c0a5760 0x7fa67c137250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa67c0a5760 0x7fa67c137250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:51218/0 (socket says 10.20.193.77:51218) 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 1 -- 10.20.193.77:0/3112298056 learned_addr learned my addr 10.20.193.77:0/3112298056 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 10 monclient(hunting): get_auth_request con 0x7fa67c0a5760 auth_method 0 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa6817ff640 1 --2- 10.20.193.77:0/3112298056 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa67c0a5380 0x7fa67c1d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa6817ff640 10 monclient(hunting): get_auth_request con 0x7fa67c0a5380 auth_method 0 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa6817ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa6817ff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa6817ff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:03.948 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa6817ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa6817ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa6817ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 10 monclient(hunting): handle_auth_done global_id 4187 payload 824 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 1 -- 10.20.193.77:0/3112298056 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa67c138140 msgr2=0x7fa67c13d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 1 --2- 10.20.193.77:0/3112298056 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa67c138140 0x7fa67c13d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 1 -- 10.20.193.77:0/3112298056 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa67c0a5380 msgr2=0x7fa67c1d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 1 --2- 10.20.193.77:0/3112298056 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa67c0a5380 0x7fa67c1d2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 1 monclient: found mon.noname-c 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 1 -- 10.20.193.77:0/3112298056 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c0a7e10 con 0x7fa67c0a5760 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa6817ff640 1 --2- 10.20.193.77:0/3112298056 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa67c0a5380 0x7fa67c1d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 1 -- 10.20.193.77:0/3112298056 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa67c0a5760 msgr2=0x7fa67c137250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa680ffe640 1 --2- 10.20.193.77:0/3112298056 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa67c0a5760 0x7fa67c137250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa67000e7f0 tx=0x7fa67000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa669ffb640 1 -- 10.20.193.77:0/3112298056 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa670017070 con 0x7fa67c0a5760 2026-02-17T12:05:03.949 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa669ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa669ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa669ffb640 10 monclient: dump: 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:epoch 1 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa669ffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa669ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa669ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa669ffb640 1 -- 10.20.193.77:0/3112298056 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67000ca60 con 0x7fa67c0a5760 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 5 monclient: authenticate success, global_id 4187 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient: _renew_subs 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 1 -- 10.20.193.77:0/3112298056 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa67c120fd0 con 0x7fa67c0a5760 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa669ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa669ffb640 1 -- 10.20.193.77:0/3112298056 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67000f040 con 0x7fa67c0a5760 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa669ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa669ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa669ffb640 10 monclient: dump: 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:epoch 1 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa66b7fe640 4 set_mon_vals no callback set 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient: _renew_subs 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:03.950 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.947+0000 7fa682801640 1 -- 10.20.193.77:0/3112298056 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa67c13eef0 con 0x7fa67c0a5760 2026-02-17T12:05:03.951 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.951+0000 7fa682801640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:03.951 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.951+0000 7fa682801640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:03.951 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.951+0000 7fa682801640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:03.951 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.951+0000 7fa682801640 1 -- 10.20.193.77:0/3112298056 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa67c073d40 con 0x7fa67c0a5760 2026-02-17T12:05:03.951 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.951+0000 7fa669ffb640 1 -- 10.20.193.77:0/3112298056 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 4) ==== 47400+0+0 (secure 0 0 0) 0x7fa670012050 con 0x7fa67c0a5760 2026-02-17T12:05:03.951 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.951+0000 7fa669ffb640 1 --2- 10.20.193.77:0/3112298056 >> v2:10.20.193.119:6800/4127986552 conn(0x7fa64c03a090 0x7fa64c03c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:03.951 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.951+0000 7fa669ffb640 1 -- 10.20.193.77:0/3112298056 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(11..11 src has 1..11) ==== 2047+0+0 (secure 0 0 0) 0x7fa67004d100 con 0x7fa67c0a5760 2026-02-17T12:05:03.951 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.951+0000 7fa6817ff640 1 --2- 10.20.193.77:0/3112298056 >> v2:10.20.193.119:6800/4127986552 conn(0x7fa64c03a090 0x7fa64c03c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:03.951 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.951+0000 7fa6817ff640 10 monclient: get_auth_request con 0x7fa64c03a090 auth_method 0 2026-02-17T12:05:03.952 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.951+0000 7fa669ffb640 1 -- 10.20.193.77:0/3112298056 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7fa67c0a7e10 con 0x7fa67c0a5760 2026-02-17T12:05:03.952 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.951+0000 7fa669ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:03.952 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.951+0000 7fa669ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:03.953 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:03.951+0000 7fa6817ff640 1 --2- 10.20.193.77:0/3112298056 >> v2:10.20.193.119:6800/4127986552 conn(0x7fa64c03a090 0x7fa64c03c550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa66c004000 tx=0x7fa66c0ae040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:04.029 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:04.029 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:04.029 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:04.029 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 1 -- 10.20.193.77:0/3112298056 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa67c0690a0 con 0x7fa67c0a5760 2026-02-17T12:05:04.029 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa669ffb640 1 -- 10.20.193.77:0/3112298056 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+5863 (secure 0 0 0) 0x7fa670013410 con 0x7fa67c0a5760 2026-02-17T12:05:04.029 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa669ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:04.029 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa669ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:04.030 INFO:teuthology.misc.health.trial077.stdout: 2026-02-17T12:05:04.030 INFO:teuthology.misc.health.trial077.stdout:{"epoch":11,"fsid":"093d53f2-7cd0-4506-a27d-4c950e190615","created":"2026-02-17T12:04:53.336611+0000","modified":"2026-02-17T12:05:03.278684+0000","last_up_change":"2026-02-17T12:05:03.278684+0000","last_in_change":"2026-02-17T12:04:55.265712+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ad6780fd-cb0e-481f-8816-a32e3434b102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6800","nonce":1107649769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":1107649769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1107649769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":1107649769}]},"public_addr":"10.20.193.77:6800/1107649769","cluster_addr":"10.20.193.77:6802/1107649769","heartbeat_back_addr":"10.20.193.77:6806/1107649769","heartbeat_front_addr":"10.20.193.77:6804/1107649769","state":["exists","up"]},{"osd":1,"uuid":"a82a493e-88de-4b65-ab23-41b52ffb6b61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"02ae9c66-fa9e-46d2-8be5-ba695ba4763b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fe40e683-451d-4e8a-94f4-69ace432df28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e6fc84bb-bd81-49d5-8cfd-b4ab0468d8dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"400ef2a1-c8ee-4376-b3d9-588e2a34ad9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:05:04.031 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 1 -- 10.20.193.77:0/3112298056 >> v2:10.20.193.119:6800/4127986552 conn(0x7fa64c03a090 msgr2=0x7fa64c03c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:04.031 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 1 --2- 10.20.193.77:0/3112298056 >> v2:10.20.193.119:6800/4127986552 conn(0x7fa64c03a090 0x7fa64c03c550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa66c004000 tx=0x7fa66c0ae040 comp rx=0 tx=0).stop 2026-02-17T12:05:04.031 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 10 monclient: shutdown 2026-02-17T12:05:04.031 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:04.031 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 1 -- 10.20.193.77:0/3112298056 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa67c0a5760 msgr2=0x7fa67c137250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:04.031 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 1 --2- 10.20.193.77:0/3112298056 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa67c0a5760 0x7fa67c137250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa67000e7f0 tx=0x7fa67000ecb0 comp rx=0 tx=0).stop 2026-02-17T12:05:04.032 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 1 -- 10.20.193.77:0/3112298056 shutdown_connections 2026-02-17T12:05:04.032 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 1 --2- 10.20.193.77:0/3112298056 >> v2:10.20.193.119:6800/4127986552 conn(0x7fa64c03a090 0x7fa64c03c550 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:04.032 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 1 --2- 10.20.193.77:0/3112298056 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa67c138140 0x7fa67c13d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:04.032 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 1 --2- 10.20.193.77:0/3112298056 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa67c0a5760 0x7fa67c137250 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:04.032 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 1 --2- 10.20.193.77:0/3112298056 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa67c0a5380 0x7fa67c1d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:04.032 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 1 -- 10.20.193.77:0/3112298056 >> 10.20.193.77:0/3112298056 conn(0x7fa67c0aab50 msgr2=0x7fa67c0a35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:04.032 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 1 -- 10.20.193.77:0/3112298056 shutdown_connections 2026-02-17T12:05:04.032 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:04.027+0000 7fa682801640 1 -- 10.20.193.77:0/3112298056 wait complete. 2026-02-17T12:05:04.038 DEBUG:teuthology.misc:1 of 6 OSDs are up 2026-02-17T12:05:04.949 INFO:tasks.ceph.osd.5.trial119.stderr:2026-02-17T12:05:04.947+0000 7f35c97ce640 -1 osd.5 0 waiting for initial osdmap 2026-02-17T12:05:04.952 INFO:tasks.ceph.osd.5.trial119.stderr:2026-02-17T12:05:04.947+0000 7f35c1601640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:05:10.643 DEBUG:teuthology.orchestra.run.trial077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T12:05:10.700 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.695+0000 7f4bb9cb8640 10 monclient: get_monmap_and_config 2026-02-17T12:05:10.700 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.695+0000 7f4bb9cb8640 10 monclient: build_initial_monmap 2026-02-17T12:05:10.701 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.695+0000 7f4bb9cb8640 10 monclient: monmap: 2026-02-17T12:05:10.701 INFO:teuthology.misc.health.trial077.stderr:epoch 0 2026-02-17T12:05:10.701 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:10.701 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:05:10.701062+0000 2026-02-17T12:05:10.701 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:05:10.701062+0000 2026-02-17T12:05:10.701 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:10.701 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:05:10.701 INFO:teuthology.misc.health.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:10.701 INFO:teuthology.misc.health.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:10.701 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:10.701 INFO:teuthology.misc.health.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:10.702 INFO:teuthology.misc.health.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:10.702 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:05:10.702 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 1 Processor -- start 2026-02-17T12:05:10.702 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 1 -- start start 2026-02-17T12:05:10.702 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 10 monclient: init 2026-02-17T12:05:10.702 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:10.702 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 10 monclient: _add_conns ranks=[2,3,1,4,0] 2026-02-17T12:05:10.702 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4bb40a7740 0x7f4bb4135070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:10.702 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 10 monclient(hunting): picked mon.noname-b con 0x7f4bb40a7740 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:10.702 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f4bb40a4b80 0x7f4bb40a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:10.702 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 10 monclient(hunting): picked mon.noname-a con 0x7f4bb40a4b80 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:10.702 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4bb4137fc0 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:10.703 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bb409d310 con 0x7f4bb4137fc0 2026-02-17T12:05:10.703 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:10.703 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb40a7b20 con 0x7f4bb40a4b80 2026-02-17T12:05:10.703 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:10.703 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb409d5f0 con 0x7f4bb40a7740 2026-02-17T12:05:10.703 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:10.703 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb9cb8640 10 monclient(hunting): authenticate will time out at 562.376474s 2026-02-17T12:05:10.703 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f4bb40a4b80 0x7f4bb40a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:10.703 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb37fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4bb40a7740 0x7f4bb4135070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:10.703 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f4bb40a4b80 0x7f4bb40a4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44238/0 (socket says 10.20.193.77:44238) 2026-02-17T12:05:10.704 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 1 -- 10.20.193.77:0/2284846914 learned_addr learned my addr 10.20.193.77:0/2284846914 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:10.704 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 10 monclient(hunting): get_auth_request con 0x7f4bb40a4b80 auth_method 0 2026-02-17T12:05:10.704 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:10.704 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:10.704 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:10.704 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb37fe640 10 monclient(hunting): get_auth_request con 0x7f4bb40a7740 auth_method 0 2026-02-17T12:05:10.704 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:10.704 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:10.705 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:10.705 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:10.705 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:10.705 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:10.705 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:10.705 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:10.705 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:10.705 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 10 monclient(hunting): handle_auth_done global_id 4206 payload 274 2026-02-17T12:05:10.705 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 1 -- 10.20.193.77:0/2284846914 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4bb40a7740 msgr2=0x7f4bb4135070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:10.706 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 1 --2- 10.20.193.77:0/2284846914 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4bb40a7740 0x7f4bb4135070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.706 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 1 -- 10.20.193.77:0/2284846914 >> v1:10.20.193.119:6789/0 conn(0x7f4bb4137fc0 legacy=0x7f4bb4138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:10.706 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:05:10.706 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 1 monclient: found mon.noname-a 2026-02-17T12:05:10.706 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:10.706 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:10.706 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 1 -- 10.20.193.77:0/2284846914 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb41355b0 con 0x7f4bb40a4b80 2026-02-17T12:05:10.715 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 1 -- 10.20.193.77:0/2284846914 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4bb40a4b80 msgr2=0x7f4bb40a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:10.716 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.699+0000 7f4bb2ffd640 1 --2- 10.20.193.77:0/2284846914 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4bb40a4b80 0x7f4bb40a4f80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009970 tx=0x7f4ba401c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dad0ff0232f0d1d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:10.716 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb27fc640 1 -- 10.20.193.77:0/2284846914 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40b0070 con 0x7f4bb40a4b80 2026-02-17T12:05:10.716 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:10.716 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:10.716 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb27fc640 10 monclient: dump: 2026-02-17T12:05:10.716 INFO:teuthology.misc.health.trial077.stderr:epoch 1 2026-02-17T12:05:10.717 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:10.717 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.717 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.717 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:10.717 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:05:10.717 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:10.717 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:10.717 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:10.718 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:05:10.718 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb27fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:10.718 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:10.718 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:10.718 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb27fc640 1 -- 10.20.193.77:0/2284846914 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba4004230 con 0x7f4bb40a4b80 2026-02-17T12:05:10.718 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:10.718 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb27fc640 1 -- 10.20.193.77:0/2284846914 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4003720 con 0x7f4bb40a4b80 2026-02-17T12:05:10.718 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 5 monclient: authenticate success, global_id 4206 2026-02-17T12:05:10.719 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:10.719 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 4 set_mon_vals no callback set 2026-02-17T12:05:10.719 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:10.719 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:10.719 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb27fc640 10 monclient: dump: 2026-02-17T12:05:10.719 INFO:teuthology.misc.health.trial077.stderr:epoch 1 2026-02-17T12:05:10.719 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:10.719 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.720 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.720 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:10.720 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:05:10.720 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:10.720 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:10.720 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:10.720 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:05:10.720 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient: shutdown 2026-02-17T12:05:10.720 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:10.721 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/2284846914 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4bb40a4b80 msgr2=0x7f4bb40a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:10.721 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 --2- 10.20.193.77:0/2284846914 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4bb40a4b80 0x7f4bb40a4f80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009970 tx=0x7f4ba401c5d0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.721 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/2284846914 shutdown_connections 2026-02-17T12:05:10.721 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 --2- 10.20.193.77:0/2284846914 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4bb40a4b80 0x7f4bb40a4f80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.721 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 --2- 10.20.193.77:0/2284846914 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4bb40a7740 0x7f4bb4135070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.721 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/2284846914 >> 10.20.193.77:0/2284846914 conn(0x7f4bb40aac50 msgr2=0x7f4bb40ab060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:10.721 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/2284846914 shutdown_connections 2026-02-17T12:05:10.721 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/2284846914 wait complete. 2026-02-17T12:05:10.722 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient: build_initial_monmap 2026-02-17T12:05:10.722 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient: monmap: 2026-02-17T12:05:10.722 INFO:teuthology.misc.health.trial077.stderr:epoch 0 2026-02-17T12:05:10.722 INFO:teuthology.misc.health.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:10.722 INFO:teuthology.misc.health.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:10.722 INFO:teuthology.misc.health.trial077.stderr:created 0.000000 2026-02-17T12:05:10.722 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:10.722 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:05:10.723 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:10.723 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:10.723 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:10.723 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:05:10.723 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 Processor -- start 2026-02-17T12:05:10.723 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 -- start start 2026-02-17T12:05:10.723 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient: init 2026-02-17T12:05:10.724 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:10.724 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:10.724 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4bb40a4b80 0x7f4bb413f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:10.724 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient(hunting): picked mon.noname-b con 0x7f4bb40a4b80 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:10.724 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4bb40a7740 0x7f4bb41d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:10.724 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient(hunting): picked mon.noname-c con 0x7f4bb40a7740 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:10.724 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4bb4137fc0 0x7f4bb41d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:10.724 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient(hunting): picked mon.noname-a con 0x7f4bb4137fc0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:10.724 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:10.725 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb4142d90 con 0x7f4bb4137fc0 2026-02-17T12:05:10.725 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:10.725 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb4134c90 con 0x7f4bb40a4b80 2026-02-17T12:05:10.725 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:10.725 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb4142f10 con 0x7f4bb40a7740 2026-02-17T12:05:10.725 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:10.725 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb9cb8640 10 monclient(hunting): authenticate will time out at 562.381782s 2026-02-17T12:05:10.725 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4bb4137fc0 0x7f4bb41d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:10.726 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4bb4137fc0 0x7f4bb41d2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44252/0 (socket says 10.20.193.77:44252) 2026-02-17T12:05:10.726 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 1 -- 10.20.193.77:0/182314428 learned_addr learned my addr 10.20.193.77:0/182314428 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:10.726 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 10 monclient(hunting): get_auth_request con 0x7f4bb4137fc0 auth_method 0 2026-02-17T12:05:10.726 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:10.726 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:10.726 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:10.726 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb2ffd640 1 --2- 10.20.193.77:0/182314428 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4bb40a7740 0x7f4bb41d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:10.727 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb2ffd640 10 monclient(hunting): get_auth_request con 0x7f4bb40a7740 auth_method 0 2026-02-17T12:05:10.727 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:10.727 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:10.727 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:10.727 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:10.727 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:10.727 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:10.727 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:10.727 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:10.728 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:10.728 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 10 monclient(hunting): handle_auth_done global_id 4209 payload 824 2026-02-17T12:05:10.728 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 1 -- 10.20.193.77:0/182314428 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4bb40a7740 msgr2=0x7f4bb41d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:10.728 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 1 --2- 10.20.193.77:0/182314428 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4bb40a7740 0x7f4bb41d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.728 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb37fe640 1 --2- 10.20.193.77:0/182314428 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4bb40a4b80 0x7f4bb413f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:10.728 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 1 -- 10.20.193.77:0/182314428 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4bb40a4b80 msgr2=0x7f4bb413f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:10.728 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 1 --2- 10.20.193.77:0/182314428 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4bb40a4b80 0x7f4bb413f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.728 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:10.729 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 1 monclient: found mon.noname-a 2026-02-17T12:05:10.729 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:10.729 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:10.729 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb3fff640 1 -- 10.20.193.77:0/182314428 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb40a5f10 con 0x7f4bb4137fc0 2026-02-17T12:05:10.729 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb37fe640 10 monclient: get_auth_request con 0x7f4bb40a4b80 auth_method 0 2026-02-17T12:05:10.729 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.703+0000 7f4bb37fe640 1 --2- 10.20.193.77:0/182314428 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4bb40a4b80 0x7f4bb413f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:05:10.729 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb3fff640 1 -- 10.20.193.77:0/182314428 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4bb4137fc0 msgr2=0x7f4bb41d2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:10.729 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb3fff640 1 --2- 10.20.193.77:0/182314428 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4bb4137fc0 0x7f4bb41d2b00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800b990 tx=0x7f4ba800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:10.730 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 1 -- 10.20.193.77:0/182314428 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba800c990 con 0x7f4bb4137fc0 2026-02-17T12:05:10.730 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:10.730 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:10.730 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 10 monclient: dump: 2026-02-17T12:05:10.730 INFO:teuthology.misc.health.trial077.stderr:epoch 1 2026-02-17T12:05:10.730 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:10.730 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.730 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.730 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:10.731 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:05:10.731 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:10.731 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:10.731 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:10.731 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:05:10.731 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 10 monclient: _finish_auth 0 2026-02-17T12:05:10.731 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:10.731 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:10.731 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 1 -- 10.20.193.77:0/182314428 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba8010070 con 0x7f4bb4137fc0 2026-02-17T12:05:10.731 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb9cb8640 5 monclient: authenticate success, global_id 4209 2026-02-17T12:05:10.731 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:10.732 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 1 -- 10.20.193.77:0/182314428 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba800cd70 con 0x7f4bb4137fc0 2026-02-17T12:05:10.732 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:10.732 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:10.732 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 10 monclient: dump: 2026-02-17T12:05:10.732 INFO:teuthology.misc.health.trial077.stderr:epoch 1 2026-02-17T12:05:10.732 INFO:teuthology.misc.health.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:10.732 INFO:teuthology.misc.health.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.732 INFO:teuthology.misc.health.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.732 INFO:teuthology.misc.health.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:10.732 INFO:teuthology.misc.health.trial077.stderr:election_strategy: 1 2026-02-17T12:05:10.732 INFO:teuthology.misc.health.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:10.732 INFO:teuthology.misc.health.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:10.732 INFO:teuthology.misc.health.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:10.732 INFO:teuthology.misc.health.trial077.stderr: 2026-02-17T12:05:10.733 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb1ffb640 4 set_mon_vals no callback set 2026-02-17T12:05:10.733 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb9cb8640 10 monclient: _renew_subs 2026-02-17T12:05:10.733 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb9cb8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:10.733 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/182314428 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb4074ba0 con 0x7f4bb4137fc0 2026-02-17T12:05:10.733 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb9cb8640 10 monclient: _renew_subs 2026-02-17T12:05:10.733 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb9cb8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:10.733 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/182314428 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb413eec0 con 0x7f4bb4137fc0 2026-02-17T12:05:10.733 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb9cb8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:10.733 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb9cb8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:10.733 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb9cb8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:10.733 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/182314428 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb40ab580 con 0x7f4bb4137fc0 2026-02-17T12:05:10.733 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 1 -- 10.20.193.77:0/182314428 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f4ba801d030 con 0x7f4bb4137fc0 2026-02-17T12:05:10.733 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 1 --2- 10.20.193.77:0/182314428 >> v2:10.20.193.119:6800/4127986552 conn(0x7f4b8403a170 0x7f4b8403c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:10.733 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4b8ffff640 1 -- 10.20.193.77:0/182314428 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3149+0+0 (secure 0 0 0) 0x7f4ba804d330 con 0x7f4bb4137fc0 2026-02-17T12:05:10.734 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb37fe640 1 --2- 10.20.193.77:0/182314428 >> v2:10.20.193.119:6800/4127986552 conn(0x7f4b8403a170 0x7f4b8403c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:10.734 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.707+0000 7f4bb37fe640 10 monclient: get_auth_request con 0x7f4b8403a170 auth_method 0 2026-02-17T12:05:10.734 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.711+0000 7f4bb37fe640 1 --2- 10.20.193.77:0/182314428 >> v2:10.20.193.119:6800/4127986552 conn(0x7f4b8403a170 0x7f4b8403c630 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009be0 tx=0x7f4ba0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:10.734 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.711+0000 7f4b8ffff640 1 -- 10.20.193.77:0/182314428 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f4ba8004250 con 0x7f4bb4137fc0 2026-02-17T12:05:10.734 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.711+0000 7f4b8ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:10.734 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.711+0000 7f4b8ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:10.789 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:10.789 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:10.789 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:10.789 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/182314428 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bb40a4f80 con 0x7f4bb4137fc0 2026-02-17T12:05:10.789 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4b8ffff640 1 -- 10.20.193.77:0/182314428 <== mon.0 v2:10.20.193.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+8911 (secure 0 0 0) 0x7f4ba801e3f0 con 0x7f4bb4137fc0 2026-02-17T12:05:10.789 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4b8ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:10.789 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4b8ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:10.790 INFO:teuthology.misc.health.trial077.stdout: 2026-02-17T12:05:10.790 INFO:teuthology.misc.health.trial077.stdout:{"epoch":16,"fsid":"093d53f2-7cd0-4506-a27d-4c950e190615","created":"2026-02-17T12:04:53.336611+0000","modified":"2026-02-17T12:05:09.040627+0000","last_up_change":"2026-02-17T12:05:05.953164+0000","last_in_change":"2026-02-17T12:04:55.265712+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T12:05:06.312998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6780fd-cb0e-481f-8816-a32e3434b102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6800","nonce":1107649769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":1107649769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1107649769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":1107649769}]},"public_addr":"10.20.193.77:6800/1107649769","cluster_addr":"10.20.193.77:6802/1107649769","heartbeat_back_addr":"10.20.193.77:6806/1107649769","heartbeat_front_addr":"10.20.193.77:6804/1107649769","state":["exists","up"]},{"osd":1,"uuid":"a82a493e-88de-4b65-ab23-41b52ffb6b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":662135547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":662135547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":662135547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":662135547}]},"public_addr":"10.20.193.77:6801/662135547","cluster_addr":"10.20.193.77:6803/662135547","heartbeat_back_addr":"10.20.193.77:6807/662135547","heartbeat_front_addr":"10.20.193.77:6805/662135547","state":["exists","up"]},{"osd":2,"uuid":"02ae9c66-fa9e-46d2-8be5-ba695ba4763b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":3812083705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":3812083705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":3812083705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":3812083705}]},"public_addr":"10.20.193.77:6808/3812083705","cluster_addr":"10.20.193.77:6809/3812083705","heartbeat_back_addr":"10.20.193.77:6811/3812083705","heartbeat_front_addr":"10.20.193.77:6810/3812083705","state":["exists","up"]},{"osd":3,"uuid":"fe40e683-451d-4e8a-94f4-69ace432df28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6801","nonce":3041501560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6802","nonce":3041501560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6804","nonce":3041501560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6803","nonce":3041501560}]},"public_addr":"10.20.193.119:6801/3041501560","cluster_addr":"10.20.193.119:6802/3041501560","heartbeat_back_addr":"10.20.193.119:6804/3041501560","heartbeat_front_addr":"10.20.193.119:6803/3041501560","state":["exists","up"]},{"osd":4,"uuid":"e6fc84bb-bd81-49d5-8cfd-b4ab0468d8dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6805","nonce":4132502681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6806","nonce":4132502681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6808","nonce":4132502681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6807","nonce":4132502681}]},"public_addr":"10.20.193.119:6805/4132502681","cluster_addr":"10.20.193.119:6806/4132502681","heartbeat_back_addr":"10.20.193.119:6808/4132502681","heartbeat_front_addr":"10.20.193.119:6807/4132502681","state":["exists","up"]},{"osd":5,"uuid":"400ef2a1-c8ee-4376-b3d9-588e2a34ad9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6809","nonce":3174335982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6810","nonce":3174335982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6812","nonce":3174335982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6811","nonce":3174335982}]},"public_addr":"10.20.193.119:6809/3174335982","cluster_addr":"10.20.193.119:6810/3174335982","heartbeat_back_addr":"10.20.193.119:6812/3174335982","heartbeat_front_addr":"10.20.193.119:6811/3174335982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:05:10.791 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/182314428 >> v2:10.20.193.119:6800/4127986552 conn(0x7f4b8403a170 msgr2=0x7f4b8403c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:10.791 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 1 --2- 10.20.193.77:0/182314428 >> v2:10.20.193.119:6800/4127986552 conn(0x7f4b8403a170 0x7f4b8403c630 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009be0 tx=0x7f4ba0008040 comp rx=0 tx=0).stop 2026-02-17T12:05:10.791 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 10 monclient: shutdown 2026-02-17T12:05:10.792 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:10.792 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/182314428 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4bb4137fc0 msgr2=0x7f4bb41d2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:10.792 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 1 --2- 10.20.193.77:0/182314428 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4bb4137fc0 0x7f4bb41d2b00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800b990 tx=0x7f4ba800be50 comp rx=0 tx=0).stop 2026-02-17T12:05:10.792 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/182314428 shutdown_connections 2026-02-17T12:05:10.792 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 1 --2- 10.20.193.77:0/182314428 >> v2:10.20.193.119:6800/4127986552 conn(0x7f4b8403a170 0x7f4b8403c630 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.792 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 1 --2- 10.20.193.77:0/182314428 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4bb4137fc0 0x7f4bb41d2b00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.792 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 1 --2- 10.20.193.77:0/182314428 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4bb40a7740 0x7f4bb41d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.792 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 1 --2- 10.20.193.77:0/182314428 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4bb40a4b80 0x7f4bb413f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.792 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/182314428 >> 10.20.193.77:0/182314428 conn(0x7f4bb40aac50 msgr2=0x7f4bb40a8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:10.792 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/182314428 shutdown_connections 2026-02-17T12:05:10.792 INFO:teuthology.misc.health.trial077.stderr:2026-02-17T12:05:10.787+0000 7f4bb9cb8640 1 -- 10.20.193.77:0/182314428 wait complete. 2026-02-17T12:05:10.798 DEBUG:teuthology.misc:6 of 6 OSDs are up 2026-02-17T12:05:10.798 INFO:tasks.ceph:Creating RBD pool 2026-02-17T12:05:10.799 DEBUG:teuthology.orchestra.run.trial077:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T12:05:10.860 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 10 monclient: get_monmap_and_config 2026-02-17T12:05:10.860 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 10 monclient: build_initial_monmap 2026-02-17T12:05:10.860 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 10 monclient: monmap: 2026-02-17T12:05:10.860 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:10.860 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:10.860 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:10.860567+0000 2026-02-17T12:05:10.860 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:10.860567+0000 2026-02-17T12:05:10.860 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:10.861 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:10.861 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:10.861 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:10.861 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:10.861 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:10.861 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:10.861 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:10.861 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 1 Processor -- start 2026-02-17T12:05:10.861 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 1 -- start start 2026-02-17T12:05:10.861 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 10 monclient: init 2026-02-17T12:05:10.861 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:10.861 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 10 monclient: _add_conns ranks=[3,1,4,0,2] 2026-02-17T12:05:10.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f403409ca20 0x7f403409ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:10.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 10 monclient(hunting): picked mon.noname-a con 0x7f403409ca20 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:10.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f40340a21a0 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:10.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f40340a2cc0 0x7f403413d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:10.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 10 monclient(hunting): picked mon.noname-c con 0x7f40340a2cc0 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:10.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f403409e330 con 0x7f40340a21a0 2026-02-17T12:05:10.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:10.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f40340750c0 con 0x7f403409ca20 2026-02-17T12:05:10.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:10.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f403409d6b0 con 0x7f40340a2cc0 2026-02-17T12:05:10.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:10.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.855+0000 7f403c282640 10 monclient(hunting): authenticate will time out at 562.535919s 2026-02-17T12:05:10.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f403409ca20 0x7f403409ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:10.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f403409ca20 0x7f403409ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44264/0 (socket says 10.20.193.77:44264) 2026-02-17T12:05:10.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 1 -- 10.20.193.77:0/3359485204 learned_addr learned my addr 10.20.193.77:0/3359485204 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:10.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 10 monclient(hunting): get_auth_request con 0x7f403409ca20 auth_method 0 2026-02-17T12:05:10.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:10.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:10.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:10.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:10.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:10.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:10.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f403a7f8640 1 --2- 10.20.193.77:0/3359485204 >> v2:10.20.193.119:3300/0 conn(0x7f40340a2cc0 0x7f403413d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:10.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 10 monclient(hunting): handle_auth_done global_id 4212 payload 274 2026-02-17T12:05:10.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 1 -- 10.20.193.77:0/3359485204 >> v2:10.20.193.119:3300/0 conn(0x7f40340a2cc0 msgr2=0x7f403413d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:10.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 1 --2- 10.20.193.77:0/3359485204 >> v2:10.20.193.119:3300/0 conn(0x7f40340a2cc0 0x7f403413d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 1 -- 10.20.193.77:0/3359485204 >> v1:10.20.193.119:6789/0 conn(0x7f40340a21a0 legacy=0x7f40340a25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:10.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 10 monclient: _finish_hunting 0 2026-02-17T12:05:10.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 1 monclient: found mon.noname-a 2026-02-17T12:05:10.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:10.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:10.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 1 -- 10.20.193.77:0/3359485204 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403409efe0 con 0x7f403409ca20 2026-02-17T12:05:10.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f403a7f8640 10 monclient: get_auth_request con 0x7f40340a2cc0 auth_method 0 2026-02-17T12:05:10.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f403a7f8640 1 --2- 10.20.193.77:0/3359485204 >> v2:10.20.193.119:3300/0 conn(0x7f40340a2cc0 0x7f403413d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:05:10.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 1 -- 10.20.193.77:0/3359485204 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f403409ca20 msgr2=0x7f403409ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:10.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4039ff7640 1 --2- 10.20.193.77:0/3359485204 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f403409ca20 0x7f403409ddf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f403409d320 tx=0x7f402401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc0e71c7c0a381c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:10.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4038ff5640 1 -- 10.20.193.77:0/3359485204 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4024004030 con 0x7f403409ca20 2026-02-17T12:05:10.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4038ff5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:10.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4038ff5640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:10.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4038ff5640 10 monclient: dump: 2026-02-17T12:05:10.871 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:10.871 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:10.871 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.871 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.871 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:10.871 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:10.871 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:10.871 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:10.872 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:10.872 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:10.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4038ff5640 10 monclient: _finish_auth 0 2026-02-17T12:05:10.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4038ff5640 10 monclient: _check_auth_tickets 2026-02-17T12:05:10.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4038ff5640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:10.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4038ff5640 1 -- 10.20.193.77:0/3359485204 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40240041d0 con 0x7f403409ca20 2026-02-17T12:05:10.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4038ff5640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:10.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4038ff5640 1 -- 10.20.193.77:0/3359485204 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40240045a0 con 0x7f403409ca20 2026-02-17T12:05:10.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4038ff5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:10.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4038ff5640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:10.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f4038ff5640 10 monclient: dump: 2026-02-17T12:05:10.872 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:10.873 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:10.873 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.873 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.873 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:10.873 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:10.873 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:10.873 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:10.873 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:10.873 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:10.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f403c282640 5 monclient: authenticate success, global_id 4212 2026-02-17T12:05:10.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f403c282640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:10.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f403c282640 4 set_mon_vals no callback set 2026-02-17T12:05:10.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f403c282640 10 monclient: shutdown 2026-02-17T12:05:10.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f403c282640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:10.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f403c282640 1 -- 10.20.193.77:0/3359485204 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f403409ca20 msgr2=0x7f403409ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:10.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.859+0000 7f403c282640 1 --2- 10.20.193.77:0/3359485204 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f403409ca20 0x7f403409ddf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f403409d320 tx=0x7f402401c500 comp rx=0 tx=0).stop 2026-02-17T12:05:10.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 1 -- 10.20.193.77:0/3359485204 shutdown_connections 2026-02-17T12:05:10.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 1 --2- 10.20.193.77:0/3359485204 >> v2:10.20.193.119:3300/0 conn(0x7f40340a2cc0 0x7f403413d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 1 --2- 10.20.193.77:0/3359485204 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f403409ca20 0x7f403409ddf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 1 -- 10.20.193.77:0/3359485204 >> 10.20.193.77:0/3359485204 conn(0x7f40340a3290 msgr2=0x7f40340a36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:10.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 1 -- 10.20.193.77:0/3359485204 shutdown_connections 2026-02-17T12:05:10.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 1 -- 10.20.193.77:0/3359485204 wait complete. 2026-02-17T12:05:10.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 10 monclient: build_initial_monmap 2026-02-17T12:05:10.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 10 monclient: monmap: 2026-02-17T12:05:10.876 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:10.876 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:10.876 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:10.876 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:10.876 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:10.876 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:10.876 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:10.876 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:10.876 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:10.877 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:10.877 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 1 Processor -- start 2026-02-17T12:05:10.877 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 1 -- start start 2026-02-17T12:05:10.877 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 10 monclient: init 2026-02-17T12:05:10.877 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:10.877 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:05:10.877 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f403409ca20 0x7f40341d1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:10.877 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 10 monclient(hunting): picked mon.noname-a con 0x7f403409ca20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:10.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40340a21a0 0x7f4034099c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:10.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 10 monclient(hunting): picked mon.noname-c con 0x7f40340a21a0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:10.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40340a2cc0 0x7f40340907c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:10.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 10 monclient(hunting): picked mon.noname-b con 0x7f40340a2cc0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:10.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:10.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4034140820 con 0x7f403409ca20 2026-02-17T12:05:10.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:10.879 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f40341406a0 con 0x7f40340a2cc0 2026-02-17T12:05:10.879 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:10.879 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f40341409a0 con 0x7f40340a21a0 2026-02-17T12:05:10.879 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:10.879 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 10 monclient(hunting): authenticate will time out at 562.541327s 2026-02-17T12:05:10.879 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f403409ca20 0x7f40341d1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:10.879 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f403409ca20 0x7f40341d1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44268/0 (socket says 10.20.193.77:44268) 2026-02-17T12:05:10.879 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 1 -- 10.20.193.77:0/3005172341 learned_addr learned my addr 10.20.193.77:0/3005172341 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:10.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 10 monclient(hunting): get_auth_request con 0x7f403409ca20 auth_method 0 2026-02-17T12:05:10.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:10.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:10.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:10.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:10.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:10.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40397f6640 1 --2- 10.20.193.77:0/3005172341 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40340a21a0 0x7f4034099c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:10.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:10.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40397f6640 10 monclient(hunting): get_auth_request con 0x7f40340a21a0 auth_method 0 2026-02-17T12:05:10.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40397f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:10.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40397f6640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:10.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40397f6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:10.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40397f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:10.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40397f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:10.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40397f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:10.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 10 monclient(hunting): handle_auth_done global_id 4215 payload 824 2026-02-17T12:05:10.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403a7f8640 1 --2- 10.20.193.77:0/3005172341 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40340a2cc0 0x7f40340907c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:10.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 1 -- 10.20.193.77:0/3005172341 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40340a21a0 msgr2=0x7f4034099c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:10.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 1 --2- 10.20.193.77:0/3005172341 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40340a21a0 0x7f4034099c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 1 -- 10.20.193.77:0/3005172341 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40340a2cc0 msgr2=0x7f40340907c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:10.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 1 --2- 10.20.193.77:0/3005172341 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40340a2cc0 0x7f40340907c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:10.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 10 monclient: _finish_hunting 0 2026-02-17T12:05:10.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 1 monclient: found mon.noname-a 2026-02-17T12:05:10.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:10.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:10.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 1 -- 10.20.193.77:0/3005172341 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4034094100 con 0x7f403409ca20 2026-02-17T12:05:10.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403a7f8640 10 monclient: get_auth_request con 0x7f40340a2cc0 auth_method 0 2026-02-17T12:05:10.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403a7f8640 1 --2- 10.20.193.77:0/3005172341 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40340a2cc0 0x7f40340907c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:05:10.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 1 -- 10.20.193.77:0/3005172341 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f403409ca20 msgr2=0x7f40341d1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:10.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4039ff7640 1 --2- 10.20.193.77:0/3005172341 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f403409ca20 0x7f40341d1ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f402401a130 tx=0x7f40240192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:10.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40227fc640 1 -- 10.20.193.77:0/3005172341 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40240ba070 con 0x7f403409ca20 2026-02-17T12:05:10.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:10.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40227fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:10.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40227fc640 10 monclient: dump: 2026-02-17T12:05:10.884 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:10.884 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:10.884 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.884 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.884 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:10.884 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:10.885 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:10.885 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:10.885 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:10.885 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:10.885 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40227fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:10.885 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40227fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:10.885 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:10.885 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40227fc640 1 -- 10.20.193.77:0/3005172341 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4024003df0 con 0x7f403409ca20 2026-02-17T12:05:10.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40227fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:10.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40227fc640 1 -- 10.20.193.77:0/3005172341 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40240b56a0 con 0x7f403409ca20 2026-02-17T12:05:10.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:10.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40227fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:10.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f40227fc640 10 monclient: dump: 2026-02-17T12:05:10.886 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:10.886 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:10.886 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.887 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:10.887 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:10.887 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:10.887 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:10.887 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:10.887 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:10.887 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:10.887 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f4023fff640 4 set_mon_vals no callback set 2026-02-17T12:05:10.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 5 monclient: authenticate success, global_id 4215 2026-02-17T12:05:10.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.863+0000 7f403c282640 10 monclient: _renew_subs 2026-02-17T12:05:10.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f403c282640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:10.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f403c282640 1 -- 10.20.193.77:0/3005172341 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40340943e0 con 0x7f403409ca20 2026-02-17T12:05:10.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f403c282640 10 monclient: _renew_subs 2026-02-17T12:05:10.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f403c282640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:10.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f403c282640 1 -- 10.20.193.77:0/3005172341 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4034092870 con 0x7f403409ca20 2026-02-17T12:05:10.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f403c282640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:10.889 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f403c282640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:10.889 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f403c282640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:10.889 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f403c282640 1 -- 10.20.193.77:0/3005172341 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f403409bbb0 con 0x7f403409ca20 2026-02-17T12:05:10.889 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f40227fc640 1 -- 10.20.193.77:0/3005172341 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f40240ac410 con 0x7f403409ca20 2026-02-17T12:05:10.889 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f40227fc640 1 --2- 10.20.193.77:0/3005172341 >> v2:10.20.193.119:6800/4127986552 conn(0x7f400403a170 0x7f400403c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:10.889 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f40227fc640 1 -- 10.20.193.77:0/3005172341 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3149+0+0 (secure 0 0 0) 0x7f40240e6e60 con 0x7f403409ca20 2026-02-17T12:05:10.889 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f40397f6640 1 --2- 10.20.193.77:0/3005172341 >> v2:10.20.193.119:6800/4127986552 conn(0x7f400403a170 0x7f400403c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:10.889 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f40397f6640 10 monclient: get_auth_request con 0x7f400403a170 auth_method 0 2026-02-17T12:05:10.889 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f40227fc640 1 -- 10.20.193.77:0/3005172341 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f40240ea030 con 0x7f403409ca20 2026-02-17T12:05:10.890 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f40227fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:10.890 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f40227fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:10.890 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.867+0000 7f40397f6640 1 --2- 10.20.193.77:0/3005172341 >> v2:10.20.193.119:6800/4127986552 conn(0x7f400403a170 0x7f400403c630 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40341cfa90 tx=0x7f4028007f40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:10.946 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.943+0000 7f403c282640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T12:05:10.946 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.943+0000 7f403c282640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T12:05:10.947 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.943+0000 7f403c282640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:10.947 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:10.943+0000 7f403c282640 1 -- 10.20.193.77:0/3005172341 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f4034074260 con 0x7f403409ca20 2026-02-17T12:05:11.269 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f40227fc640 1 -- 10.20.193.77:0/3005172341 <== mon.0 v2:10.20.193.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) ==== 109+0+0 (secure 0 0 0) 0x7f4024016210 con 0x7f403409ca20 2026-02-17T12:05:11.269 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f40227fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T12:05:11.270 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f40227fc640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-17T12:05:11.270 INFO:teuthology.orchestra.run.trial077.stderr:pool 'rbd' created 2026-02-17T12:05:11.272 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f403c282640 1 -- 10.20.193.77:0/3005172341 >> v2:10.20.193.119:6800/4127986552 conn(0x7f400403a170 msgr2=0x7f400403c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:11.272 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f403c282640 1 --2- 10.20.193.77:0/3005172341 >> v2:10.20.193.119:6800/4127986552 conn(0x7f400403a170 0x7f400403c630 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40341cfa90 tx=0x7f4028007f40 comp rx=0 tx=0).stop 2026-02-17T12:05:11.272 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f403c282640 10 monclient: shutdown 2026-02-17T12:05:11.272 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f403c282640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:11.272 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f403c282640 1 -- 10.20.193.77:0/3005172341 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f403409ca20 msgr2=0x7f40341d1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:11.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f403c282640 1 --2- 10.20.193.77:0/3005172341 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f403409ca20 0x7f40341d1ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f402401a130 tx=0x7f40240192a0 comp rx=0 tx=0).stop 2026-02-17T12:05:11.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f403c282640 1 -- 10.20.193.77:0/3005172341 shutdown_connections 2026-02-17T12:05:11.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f403c282640 1 --2- 10.20.193.77:0/3005172341 >> v2:10.20.193.119:6800/4127986552 conn(0x7f400403a170 0x7f400403c630 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:11.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f403c282640 1 --2- 10.20.193.77:0/3005172341 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40340a2cc0 0x7f40340907c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:11.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f403c282640 1 --2- 10.20.193.77:0/3005172341 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40340a21a0 0x7f4034099c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:11.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f403c282640 1 --2- 10.20.193.77:0/3005172341 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f403409ca20 0x7f40341d1ed0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:11.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f403c282640 1 -- 10.20.193.77:0/3005172341 >> 10.20.193.77:0/3005172341 conn(0x7f40340a3290 msgr2=0x7f403413d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:11.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f403c282640 1 -- 10.20.193.77:0/3005172341 shutdown_connections 2026-02-17T12:05:11.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.267+0000 7f403c282640 1 -- 10.20.193.77:0/3005172341 wait complete. 2026-02-17T12:05:11.281 DEBUG:teuthology.orchestra.run.trial077:> rbd --cluster ceph pool init rbd 2026-02-17T12:05:11.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 10 monclient: get_monmap_and_config 2026-02-17T12:05:11.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 10 monclient: build_initial_monmap 2026-02-17T12:05:11.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 10 monclient: monmap: 2026-02-17T12:05:11.300 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:11.300 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:11.300 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:11.302134+0000 2026-02-17T12:05:11.300 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:11.302134+0000 2026-02-17T12:05:11.300 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:11.300 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:11.301 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:11.301 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:11.301 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:11.301 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:11.301 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:11.301 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:11.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 1 Processor -- start 2026-02-17T12:05:11.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 1 -- start start 2026-02-17T12:05:11.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 10 monclient: init 2026-02-17T12:05:11.303 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 10 monclient: _reopen_session rank -1 2026-02-17T12:05:11.303 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 10 monclient: _add_conns ranks=[1,2,0,3,4] 2026-02-17T12:05:11.303 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 10 monclient(hunting): picked mon.noname-c-legacy con 0x55cdab0f6520 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:11.303 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x55cdab0f6900 0x55cdab0f6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:11.303 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 10 monclient(hunting): picked mon.noname-b con 0x55cdab0f6900 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:11.303 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 10 monclient(hunting): picked mon.noname-a-legacy con 0x55cdab198080 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:11.303 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55cdaaf78dc0 con 0x55cdab198080 2026-02-17T12:05:11.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55cdaaf5d470 con 0x55cdab0f6520 2026-02-17T12:05:11.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:11.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x55cdaaf75890 con 0x55cdab0f6900 2026-02-17T12:05:11.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 10 monclient(hunting): _renew_subs 2026-02-17T12:05:11.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229df4d080 10 monclient(hunting): authenticate will time out at 562.977654s 2026-02-17T12:05:11.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x55cdab0f6900 0x55cdab0f6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:11.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229dcbb640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x55cdab198080 0x55cdab19a470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42320/0 (socket says 10.20.193.77:42320) 2026-02-17T12:05:11.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f229dcbb640 1 -- 10.20.193.77:0/1288704586 learned_addr learned my addr 10.20.193.77:0/1288704586 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:11.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 10 monclient(hunting): get_auth_request con 0x55cdab0f6900 auth_method 0 2026-02-17T12:05:11.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:11.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:11.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:11.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:11.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:11.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:11.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 10 monclient(hunting): handle_auth_done global_id 4208 payload 274 2026-02-17T12:05:11.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 1 -- 10.20.193.77:0/1288704586 >> v1:10.20.193.119:6789/0 conn(0x55cdab0f6520 legacy=0x55cdab0f7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:11.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 1 -- 10.20.193.77:0/1288704586 >> v1:10.20.193.77:6789/0 conn(0x55cdab198080 legacy=0x55cdab19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:11.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:11.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 1 monclient: found mon.noname-b 2026-02-17T12:05:11.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:11.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:11.306 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.299+0000 7f2297fff640 1 -- 10.20.193.77:0/1288704586 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdaaf487c0 con 0x55cdab0f6900 2026-02-17T12:05:11.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 1 -- 10.20.193.77:0/1288704586 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x55cdab0f6900 msgr2=0x55cdab0f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:11.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 1 --2- 10.20.193.77:0/1288704586 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x55cdab0f6900 0x55cdab0f6ce0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f228400a530 tx=0x7f228401b2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bad21bcf851d273 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:11.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f22977fe640 1 -- 10.20.193.77:0/1288704586 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22840af070 con 0x55cdab0f6900 2026-02-17T12:05:11.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f22977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:11.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f22977fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:11.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f22977fe640 10 monclient: dump: 2026-02-17T12:05:11.311 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:11.311 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:11.311 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:11.312 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:11.312 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:11.312 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:11.312 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:11.312 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:11.312 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:11.312 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:11.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f22977fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:11.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f22977fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:11.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f22977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:11.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f22977fe640 1 -- 10.20.193.77:0/1288704586 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2284006670 con 0x55cdab0f6900 2026-02-17T12:05:11.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 5 monclient: authenticate success, global_id 4208 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f22977fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f22977fe640 1 -- 10.20.193.77:0/1288704586 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284006a40 con 0x55cdab0f6900 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f22977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f22977fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f22977fe640 10 monclient: dump: 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:11.313 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:11.314 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:11.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient: get_monmap_and_config success 2026-02-17T12:05:11.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 4 set_mon_vals no callback set 2026-02-17T12:05:11.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient: shutdown 2026-02-17T12:05:11.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:11.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 -- 10.20.193.77:0/1288704586 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x55cdab0f6900 msgr2=0x55cdab0f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:11.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 --2- 10.20.193.77:0/1288704586 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x55cdab0f6900 0x55cdab0f6ce0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f228400a530 tx=0x7f228401b2d0 comp rx=0 tx=0).stop 2026-02-17T12:05:11.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 -- 10.20.193.77:0/1288704586 shutdown_connections 2026-02-17T12:05:11.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 --2- 10.20.193.77:0/1288704586 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x55cdab0f6900 0x55cdab0f6ce0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:11.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 -- 10.20.193.77:0/1288704586 >> 10.20.193.77:0/1288704586 conn(0x55cdab100790 msgr2=0x55cdab0e1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:11.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 -- 10.20.193.77:0/1288704586 shutdown_connections 2026-02-17T12:05:11.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 -- 10.20.193.77:0/1288704586 wait complete. 2026-02-17T12:05:11.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient: build_initial_monmap 2026-02-17T12:05:11.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient: monmap: 2026-02-17T12:05:11.315 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:11.315 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:11.315 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:11.315 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:11.315 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:11.315 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:11.315 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:11.315 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:11.315 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:11.315 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:11.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 Processor -- start 2026-02-17T12:05:11.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 -- start start 2026-02-17T12:05:11.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient: init 2026-02-17T12:05:11.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient: _reopen_session rank -1 2026-02-17T12:05:11.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:05:11.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x55cdab0f6520 0x55cdab1978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:11.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient(hunting): picked mon.noname-a con 0x55cdab0f6520 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:11.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x55cdab0f6900 0x55cdab0fbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:11.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient(hunting): picked mon.noname-c con 0x55cdab0f6900 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:11.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x55cdab198080 0x55cdab0fc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:11.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient(hunting): picked mon.noname-b con 0x55cdab198080 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:11.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:11.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x55cdaafc5d00 con 0x55cdab0f6520 2026-02-17T12:05:11.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:11.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x55cdaafc9dd0 con 0x55cdab198080 2026-02-17T12:05:11.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:11.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x55cdaaf64a90 con 0x55cdab0f6900 2026-02-17T12:05:11.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient(hunting): _renew_subs 2026-02-17T12:05:11.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229df4d080 10 monclient(hunting): authenticate will time out at 562.983498s 2026-02-17T12:05:11.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229ca32640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x55cdab0f6520 0x55cdab1978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:11.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x55cdab0f6900 0x55cdab0fbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:11.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229ca32640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x55cdab0f6520 0x55cdab1978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44280/0 (socket says 10.20.193.77:44280) 2026-02-17T12:05:11.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x55cdab0f6900 0x55cdab0fbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50622/0 (socket says 10.20.193.77:50622) 2026-02-17T12:05:11.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229ca32640 1 -- 10.20.193.77:0/2926362406 learned_addr learned my addr 10.20.193.77:0/2926362406 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:11.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229ca32640 10 monclient(hunting): get_auth_request con 0x55cdab0f6520 auth_method 0 2026-02-17T12:05:11.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229ca32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:11.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229ca32640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:11.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229ca32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:11.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 10 monclient(hunting): get_auth_request con 0x55cdab0f6900 auth_method 0 2026-02-17T12:05:11.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:11.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:11.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:11.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229ca32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:11.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229ca32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:11.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229dcbb640 1 --2- 10.20.193.77:0/2926362406 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x55cdab198080 0x55cdab0fc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:11.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229ca32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:11.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:11.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:11.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:11.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229dcbb640 10 monclient(hunting): get_auth_request con 0x55cdab198080 auth_method 0 2026-02-17T12:05:11.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229dcbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:11.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229dcbb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:11.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229dcbb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:11.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229dcbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:11.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229dcbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:11.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229dcbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:11.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 10 monclient(hunting): handle_auth_done global_id 4211 payload 824 2026-02-17T12:05:11.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 1 -- 10.20.193.77:0/2926362406 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x55cdab198080 msgr2=0x55cdab0fc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:11.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 1 --2- 10.20.193.77:0/2926362406 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x55cdab198080 0x55cdab0fc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:11.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 1 -- 10.20.193.77:0/2926362406 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x55cdab0f6520 msgr2=0x55cdab1978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:11.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 1 --2- 10.20.193.77:0/2926362406 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x55cdab0f6520 0x55cdab1978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:11.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:11.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 1 monclient: found mon.noname-c 2026-02-17T12:05:11.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:11.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:11.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f2297fff640 1 -- 10.20.193.77:0/2926362406 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdab17feb0 con 0x55cdab0f6900 2026-02-17T12:05:11.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.303+0000 7f229ca32640 1 --2- 10.20.193.77:0/2926362406 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x55cdab0f6520 0x55cdab1978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:11.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2297fff640 1 -- 10.20.193.77:0/2926362406 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x55cdab0f6900 msgr2=0x55cdab0fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:11.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2297fff640 1 --2- 10.20.193.77:0/2926362406 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x55cdab0f6900 0x55cdab0fbc70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x55cdab0e2f10 tx=0x7f2284018070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:11.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 1 -- 10.20.193.77:0/2926362406 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22840b8020 con 0x55cdab0f6900 2026-02-17T12:05:11.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:11.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:11.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 10 monclient: dump: 2026-02-17T12:05:11.320 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:11.320 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:11.320 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:11.320 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:11.320 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:11.320 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:11.320 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:11.321 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:11.321 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:11.321 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:11.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 10 monclient: _finish_auth 0 2026-02-17T12:05:11.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:05:11.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:11.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 1 -- 10.20.193.77:0/2926362406 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22840b4840 con 0x55cdab0f6900 2026-02-17T12:05:11.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f229df4d080 5 monclient: authenticate success, global_id 4211 2026-02-17T12:05:11.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f229df4d080 10 monclient: _renew_subs 2026-02-17T12:05:11.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f229df4d080 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:11.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f229df4d080 1 -- 10.20.193.77:0/2926362406 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cdab19b7b0 con 0x55cdab0f6900 2026-02-17T12:05:11.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:11.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 1 -- 10.20.193.77:0/2926362406 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22840af040 con 0x55cdab0f6900 2026-02-17T12:05:11.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:11.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:11.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 10 monclient: dump: 2026-02-17T12:05:11.322 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:11.322 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:11.322 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:11.322 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:11.322 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:11.322 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:11.322 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:11.322 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:11.322 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:11.323 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:11.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2296ffd640 4 set_mon_vals no callback set 2026-02-17T12:05:11.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f229df4d080 10 monclient: _renew_subs 2026-02-17T12:05:11.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f229df4d080 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:11.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f229df4d080 1 -- 10.20.193.77:0/2926362406 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55cdab17f8f0 con 0x55cdab0f6900 2026-02-17T12:05:11.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 1 -- 10.20.193.77:0/2926362406 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f22840b4c70 con 0x55cdab0f6900 2026-02-17T12:05:11.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 1 --2- 10.20.193.77:0/2926362406 >> v2:10.20.193.119:6800/4127986552 conn(0x7f227c038910 0x7f227c03add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:11.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f2294ff9640 1 -- 10.20.193.77:0/2926362406 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3491+0+0 (secure 0 0 0) 0x7f22840e7350 con 0x55cdab0f6900 2026-02-17T12:05:11.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f229df4d080 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T12:05:11.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f229df4d080 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T12:05:11.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f229df4d080 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:11.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f229df4d080 1 -- 10.20.193.77:0/2926362406 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55cdab17e730 con 0x55cdab0f6900 2026-02-17T12:05:11.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f229ca32640 1 --2- 10.20.193.77:0/2926362406 >> v2:10.20.193.119:6800/4127986552 conn(0x7f227c038910 0x7f227c03add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:11.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.307+0000 7f229ca32640 10 monclient: get_auth_request con 0x7f227c038910 auth_method 0 2026-02-17T12:05:11.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:11.311+0000 7f229ca32640 1 --2- 10.20.193.77:0/2926362406 >> v2:10.20.193.119:6800/4127986552 conn(0x7f227c038910 0x7f227c03add0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f228c002ef0 tx=0x7f228c002870 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:12.272 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f2294ff9640 1 -- 10.20.193.77:0/2926362406 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v18) ==== 141+0+0 (secure 0 0 0) 0x7f22840c2030 con 0x55cdab0f6900 2026-02-17T12:05:12.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f2294ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T12:05:12.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f2294ff9640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-17T12:05:12.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f229df4d080 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:12.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f229df4d080 1 -- 10.20.193.77:0/2926362406 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2284006670 con 0x55cdab0f6900 2026-02-17T12:05:12.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f2294ff9640 1 -- 10.20.193.77:0/2926362406 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f22840a93a0 con 0x55cdab0f6900 2026-02-17T12:05:12.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f2294ff9640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-17T12:05:12.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f2296ffd640 10 monclient: _renew_subs 2026-02-17T12:05:12.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f2296ffd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:12.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f2296ffd640 1 -- 10.20.193.77:0/2926362406 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=18}) -- 0x7f2274002af0 con 0x55cdab0f6900 2026-02-17T12:05:12.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f2294ff9640 1 -- 10.20.193.77:0/2926362406 <== mon.2 v2:10.20.193.77:3301/0 8 ==== osd_map(18..18 src has 1..18) ==== 658+0+0 (secure 0 0 0) 0x7f22840b2d50 con 0x55cdab0f6900 2026-02-17T12:05:12.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f229df4d080 1 --2- 10.20.193.77:0/2926362406 >> v2:10.20.193.119:6809/3174335982 conn(0x55cdab1ab960 0x55cdab1add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:12.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f229df4d080 1 -- 10.20.193.77:0/2926362406 --> v2:10.20.193.119:6809/3174335982 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x55cdab1ae290 con 0x55cdab1ab960 2026-02-17T12:05:12.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f229dcbb640 1 --2- 10.20.193.77:0/2926362406 >> v2:10.20.193.119:6809/3174335982 conn(0x55cdab1ab960 0x55cdab1add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:12.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.271+0000 7f229dcbb640 10 monclient: get_auth_request con 0x55cdab1ab960 auth_method 0 2026-02-17T12:05:12.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.275+0000 7f229dcbb640 1 --2- 10.20.193.77:0/2926362406 >> v2:10.20.193.119:6809/3174335982 conn(0x55cdab1ab960 0x55cdab1add50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:12.279 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.279+0000 7f229dcbb640 1 -- 10.20.193.77:0/2926362406 <== osd.5 v2:10.20.193.119:6809/3174335982 1 ==== osd_op_reply(1 rbd_trash [create] v18'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f22900055c0 con 0x55cdab1ab960 2026-02-17T12:05:12.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.279+0000 7f229df4d080 1 -- 10.20.193.77:0/2926362406 --> v2:10.20.193.119:6809/3174335982 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) -- 0x55cdab200cb0 con 0x55cdab1ab960 2026-02-17T12:05:12.281 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.279+0000 7f229dcbb640 1 -- 10.20.193.77:0/2926362406 <== osd.5 v2:10.20.193.119:6809/3174335982 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f22900055c0 con 0x55cdab1ab960 2026-02-17T12:05:12.281 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.279+0000 7f229df4d080 1 -- 10.20.193.77:0/2926362406 --> v2:10.20.193.119:6809/3174335982 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) -- 0x55cdab1ffdc0 con 0x55cdab1ab960 2026-02-17T12:05:12.281 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.279+0000 7f229dcbb640 1 -- 10.20.193.77:0/2926362406 <== osd.5 v2:10.20.193.119:6809/3174335982 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f22900055c0 con 0x55cdab1ab960 2026-02-17T12:05:12.281 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.279+0000 7f22967fc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:12.281 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:12.279+0000 7f22967fc640 1 -- 10.20.193.77:0/2926362406 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f2278001f10 con 0x55cdab0f6900 2026-02-17T12:05:13.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:13.275+0000 7f2294ff9640 1 -- 10.20.193.77:0/2926362406 <== mon.2 v2:10.20.193.77:3301/0 9 ==== pool_op_reply(tid 4 (0) Success v19) ==== 55+0+0 (secure 0 0 0) 0x7f2284014fe0 con 0x55cdab0f6900 2026-02-17T12:05:13.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:13.275+0000 7f2294ff9640 10 monclient: _renew_subs 2026-02-17T12:05:13.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:13.275+0000 7f2294ff9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:13.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:13.275+0000 7f2294ff9640 1 -- 10.20.193.77:0/2926362406 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=19}) -- 0x7f227c03e830 con 0x55cdab0f6900 2026-02-17T12:05:13.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:13.275+0000 7f2294ff9640 1 -- 10.20.193.77:0/2926362406 <== mon.2 v2:10.20.193.77:3301/0 10 ==== osd_map(19..19 src has 1..19) ==== 626+0+0 (secure 0 0 0) 0x7f22840aa790 con 0x55cdab0f6900 2026-02-17T12:05:13.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:13.275+0000 7f2296ffd640 1 -- 10.20.193.77:0/2926362406 --> v2:10.20.193.119:6809/3174335982 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7f22740056d0 con 0x55cdab1ab960 2026-02-17T12:05:13.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:13.279+0000 7f229dcbb640 1 -- 10.20.193.77:0/2926362406 <== osd.5 v2:10.20.193.119:6809/3174335982 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v19'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f22900055c0 con 0x55cdab1ab960 2026-02-17T12:05:13.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:13.279+0000 7f22967fc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:13.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:13.279+0000 7f22967fc640 1 -- 10.20.193.77:0/2926362406 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v19) -- 0x7f2278003360 con 0x55cdab0f6900 2026-02-17T12:05:14.306 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.303+0000 7f22837fe640 10 monclient: tick 2026-02-17T12:05:14.306 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.303+0000 7f22837fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:14.307 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.303+0000 7f22837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:14.307 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.303+0000 7f22837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:14.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.471+0000 7f2294ff9640 1 -- 10.20.193.77:0/2926362406 <== mon.2 v2:10.20.193.77:3301/0 11 ==== pool_op_reply(tid 6 (0) Success v20) ==== 43+0+0 (secure 0 0 0) 0x7f22840cb030 con 0x55cdab0f6900 2026-02-17T12:05:14.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.471+0000 7f2294ff9640 10 monclient: _renew_subs 2026-02-17T12:05:14.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.471+0000 7f2294ff9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.471+0000 7f2294ff9640 1 -- 10.20.193.77:0/2926362406 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=20}) -- 0x7f227c03e8e0 con 0x55cdab0f6900 2026-02-17T12:05:14.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.471+0000 7f2294ff9640 1 -- 10.20.193.77:0/2926362406 <== mon.2 v2:10.20.193.77:3301/0 12 ==== osd_map(20..20 src has 1..20) ==== 654+0+0 (secure 0 0 0) 0x7f22840aa400 con 0x55cdab0f6900 2026-02-17T12:05:14.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.471+0000 7f2296ffd640 1 -- 10.20.193.77:0/2926362406 --> v2:10.20.193.119:6809/3174335982 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20) -- 0x7f2274005a70 con 0x55cdab1ab960 2026-02-17T12:05:14.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.475+0000 7f229dcbb640 1 -- 10.20.193.77:0/2926362406 <== osd.5 v2:10.20.193.119:6809/3174335982 5 ==== osd_op_reply(7 rbd_info [write 0~19] v20'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22900055c0 con 0x55cdab1ab960 2026-02-17T12:05:14.476 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.475+0000 7f229df4d080 1 -- 10.20.193.77:0/2926362406 >> v2:10.20.193.119:6809/3174335982 conn(0x55cdab1ab960 msgr2=0x55cdab1add50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.476 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.475+0000 7f229df4d080 1 --2- 10.20.193.77:0/2926362406 >> v2:10.20.193.119:6809/3174335982 conn(0x55cdab1ab960 0x55cdab1add50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.476 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.475+0000 7f229df4d080 1 -- 10.20.193.77:0/2926362406 >> v2:10.20.193.119:6800/4127986552 conn(0x7f227c038910 msgr2=0x7f227c03add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.477 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.475+0000 7f229df4d080 1 --2- 10.20.193.77:0/2926362406 >> v2:10.20.193.119:6800/4127986552 conn(0x7f227c038910 0x7f227c03add0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f228c002ef0 tx=0x7f228c002870 comp rx=0 tx=0).stop 2026-02-17T12:05:14.477 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.475+0000 7f229df4d080 10 monclient: shutdown 2026-02-17T12:05:14.477 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.475+0000 7f229df4d080 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:14.477 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.475+0000 7f229df4d080 1 -- 10.20.193.77:0/2926362406 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x55cdab0f6900 msgr2=0x55cdab0fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.477 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.475+0000 7f229df4d080 1 --2- 10.20.193.77:0/2926362406 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x55cdab0f6900 0x55cdab0fbc70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x55cdab0e2f10 tx=0x7f2284018070 comp rx=0 tx=0).stop 2026-02-17T12:05:14.477 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.475+0000 7f229dcbb640 1 -- 10.20.193.77:0/2926362406 reap_dead start 2026-02-17T12:05:14.477 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.475+0000 7f229df4d080 1 -- 10.20.193.77:0/2926362406 shutdown_connections 2026-02-17T12:05:14.477 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.475+0000 7f229df4d080 1 -- 10.20.193.77:0/2926362406 >> 10.20.193.77:0/2926362406 conn(0x55cdab100790 msgr2=0x55cdab1011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:14.477 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.475+0000 7f229df4d080 1 -- 10.20.193.77:0/2926362406 shutdown_connections 2026-02-17T12:05:14.477 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.475+0000 7f229df4d080 1 -- 10.20.193.77:0/2926362406 wait complete. 2026-02-17T12:05:14.481 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T12:05:14.482 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T12:05:14.482 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T12:05:14.482 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T12:05:14.482 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T12:05:14.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 10 monclient: get_monmap_and_config 2026-02-17T12:05:14.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 10 monclient: build_initial_monmap 2026-02-17T12:05:14.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 10 monclient: monmap: 2026-02-17T12:05:14.585 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:14.585 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.585 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:14.584483+0000 2026-02-17T12:05:14.585 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:14.584483+0000 2026-02-17T12:05:14.585 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:14.585 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.585 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:14.585 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:14.585 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:14.585 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:14.586 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:14.586 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.586 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 1 Processor -- start 2026-02-17T12:05:14.586 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 1 -- start start 2026-02-17T12:05:14.586 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 10 monclient: init 2026-02-17T12:05:14.586 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:14.586 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 10 monclient: _add_conns ranks=[3,2,0,4,1] 2026-02-17T12:05:14.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f97fc09be20 0x7f97fc134fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 10 monclient(hunting): picked mon.noname-a con 0x7f97fc09be20 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:14.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc0a4b60 0x7f97fc0a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 10 monclient(hunting): picked mon.noname-b con 0x7f97fc0a4b60 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:14.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f97fc138000 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:14.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97fc09d2f0 con 0x7f97fc138000 2026-02-17T12:05:14.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:14.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f97fc09c480 con 0x7f97fc09be20 2026-02-17T12:05:14.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:14.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc09c200 con 0x7f97fc0a4b60 2026-02-17T12:05:14.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:14.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f9801d47640 10 monclient(hunting): authenticate will time out at 566.259877s 2026-02-17T12:05:14.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.579+0000 7f97fb7fe640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f97fc09be20 0x7f97fc134fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc0a4b60 0x7f97fc0a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fb7fe640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f97fc09be20 0x7f97fc134fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44294/0 (socket says 10.20.193.77:44294) 2026-02-17T12:05:14.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fb7fe640 1 -- 10.20.193.77:0/3251151703 learned_addr learned my addr 10.20.193.77:0/3251151703 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:14.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fbfff640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f97fc138000 0x7f97fc1384b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42328/0 (socket says 10.20.193.77:42328) 2026-02-17T12:05:14.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 10 monclient(hunting): get_auth_request con 0x7f97fc0a4b60 auth_method 0 2026-02-17T12:05:14.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:14.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:14.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:14.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fb7fe640 10 monclient(hunting): get_auth_request con 0x7f97fc09be20 auth_method 0 2026-02-17T12:05:14.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:14.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:14.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:14.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:14.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:14.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:14.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:14.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:14.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:14.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 10 monclient(hunting): handle_auth_done global_id 4214 payload 274 2026-02-17T12:05:14.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 1 -- 10.20.193.77:0/3251151703 >> v2:10.20.193.77:3300/0 conn(0x7f97fc09be20 msgr2=0x7f97fc134fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:14.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 1 --2- 10.20.193.77:0/3251151703 >> v2:10.20.193.77:3300/0 conn(0x7f97fc09be20 0x7f97fc134fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 1 -- 10.20.193.77:0/3251151703 >> v1:10.20.193.77:6789/0 conn(0x7f97fc138000 legacy=0x7f97fc1384b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:14.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 10 monclient: _finish_hunting 0 2026-02-17T12:05:14.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 1 monclient: found mon.noname-b 2026-02-17T12:05:14.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:14.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 1 -- 10.20.193.77:0/3251151703 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc09cd30 con 0x7f97fc0a4b60 2026-02-17T12:05:14.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 1 -- 10.20.193.77:0/3251151703 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc0a4b60 msgr2=0x7f97fc0a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:14.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97faffd640 1 --2- 10.20.193.77:0/3251151703 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc0a4b60 0x7f97fc0a4fa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0098c0 tx=0x7f97ec01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2494c396b34edb9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:14.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fa7fc640 1 -- 10.20.193.77:0/3251151703 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0b1070 con 0x7f97fc0a4b60 2026-02-17T12:05:14.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:14.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fa7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:14.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fa7fc640 10 monclient: dump: 2026-02-17T12:05:14.596 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:14.596 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.597 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.597 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.597 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:14.597 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.597 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:14.597 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:14.597 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:14.597 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fa7fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:14.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fa7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:14.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:14.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fa7fc640 1 -- 10.20.193.77:0/3251151703 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97ec0ac640 con 0x7f97fc0a4b60 2026-02-17T12:05:14.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fa7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:14.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fa7fc640 1 -- 10.20.193.77:0/3251151703 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0aca10 con 0x7f97fc0a4b60 2026-02-17T12:05:14.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:14.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:14.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f97fa7fc640 10 monclient: dump: 2026-02-17T12:05:14.598 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:14.598 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.599 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.599 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.599 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:14.599 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.599 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:14.599 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:14.599 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:14.599 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f9801d47640 5 monclient: authenticate success, global_id 4214 2026-02-17T12:05:14.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f9801d47640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:14.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.583+0000 7f9801d47640 4 set_mon_vals no callback set 2026-02-17T12:05:14.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 10 monclient: shutdown 2026-02-17T12:05:14.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:14.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 -- 10.20.193.77:0/3251151703 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc0a4b60 msgr2=0x7f97fc0a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 --2- 10.20.193.77:0/3251151703 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc0a4b60 0x7f97fc0a4fa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0098c0 tx=0x7f97ec01c480 comp rx=0 tx=0).stop 2026-02-17T12:05:14.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 -- 10.20.193.77:0/3251151703 shutdown_connections 2026-02-17T12:05:14.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 --2- 10.20.193.77:0/3251151703 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc0a4b60 0x7f97fc0a4fa0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 --2- 10.20.193.77:0/3251151703 >> v2:10.20.193.77:3300/0 conn(0x7f97fc09be20 0x7f97fc134fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 -- 10.20.193.77:0/3251151703 >> 10.20.193.77:0/3251151703 conn(0x7f97fc074b90 msgr2=0x7f97fc0aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:14.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 -- 10.20.193.77:0/3251151703 shutdown_connections 2026-02-17T12:05:14.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 -- 10.20.193.77:0/3251151703 wait complete. 2026-02-17T12:05:14.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 10 monclient: build_initial_monmap 2026-02-17T12:05:14.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 10 monclient: monmap: 2026-02-17T12:05:14.600 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:14.601 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:14.601 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:14.601 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:14.601 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:14.601 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.601 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:14.601 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:14.601 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:14.601 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.601 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 Processor -- start 2026-02-17T12:05:14.601 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 -- start start 2026-02-17T12:05:14.601 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 10 monclient: init 2026-02-17T12:05:14.601 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:14.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:05:14.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc09be20 0x7f97fc12e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 10 monclient(hunting): picked mon.noname-c con 0x7f97fc09be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:14.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f97fc0a4b60 0x7f97fc12ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 10 monclient(hunting): picked mon.noname-b con 0x7f97fc0a4b60 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:14.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f97fc138000 0x7f97fc1d2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 10 monclient(hunting): picked mon.noname-a con 0x7f97fc138000 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:14.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:14.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc142fd0 con 0x7f97fc138000 2026-02-17T12:05:14.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:14.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc142e50 con 0x7f97fc0a4b60 2026-02-17T12:05:14.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:14.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc143150 con 0x7f97fc09be20 2026-02-17T12:05:14.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:14.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f9801d47640 10 monclient(hunting): authenticate will time out at 566.265618s 2026-02-17T12:05:14.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc09be20 0x7f97fc12e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc09be20 0x7f97fc12e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50636/0 (socket says 10.20.193.77:50636) 2026-02-17T12:05:14.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 1 -- 10.20.193.77:0/3160605161 learned_addr learned my addr 10.20.193.77:0/3160605161 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:14.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 10 monclient(hunting): get_auth_request con 0x7f97fc09be20 auth_method 0 2026-02-17T12:05:14.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:14.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:14.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:14.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:14.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:14.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:14.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fbfff640 1 --2- 10.20.193.77:0/3160605161 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f97fc138000 0x7f97fc1d2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fbfff640 10 monclient(hunting): get_auth_request con 0x7f97fc138000 auth_method 0 2026-02-17T12:05:14.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:14.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:14.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:14.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 10 monclient(hunting): handle_auth_done global_id 4217 payload 824 2026-02-17T12:05:14.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 1 -- 10.20.193.77:0/3160605161 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f97fc0a4b60 msgr2=0x7f97fc12ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 1 --2- 10.20.193.77:0/3160605161 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f97fc0a4b60 0x7f97fc12ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 1 -- 10.20.193.77:0/3160605161 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f97fc138000 msgr2=0x7f97fc1d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 1 --2- 10.20.193.77:0/3160605161 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f97fc138000 0x7f97fc1d2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:14.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 1 monclient: found mon.noname-c 2026-02-17T12:05:14.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:14.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 1 -- 10.20.193.77:0/3160605161 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc0a3ce0 con 0x7f97fc09be20 2026-02-17T12:05:14.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 1 -- 10.20.193.77:0/3160605161 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc09be20 msgr2=0x7f97fc12e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:14.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97fb7fe640 1 --2- 10.20.193.77:0/3160605161 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc09be20 0x7f97fc12e6a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f97e800e9b0 tx=0x7f97e800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:14.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.587+0000 7f97d7fff640 1 -- 10.20.193.77:0/3160605161 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8017070 con 0x7f97fc09be20 2026-02-17T12:05:14.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:14.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:14.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 10 monclient: dump: 2026-02-17T12:05:14.605 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:14.605 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.605 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.606 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.606 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:14.606 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.606 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:14.606 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:14.606 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:14.606 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 10 monclient: _finish_auth 0 2026-02-17T12:05:14.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:14.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:14.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 1 -- 10.20.193.77:0/3160605161 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e800cc10 con 0x7f97fc09be20 2026-02-17T12:05:14.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:14.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 1 -- 10.20.193.77:0/3160605161 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8013470 con 0x7f97fc09be20 2026-02-17T12:05:14.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:14.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:14.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 10 monclient: dump: 2026-02-17T12:05:14.607 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:14.607 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.607 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.607 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.607 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:14.607 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.607 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:14.607 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:14.607 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:14.608 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97f9ffb640 4 set_mon_vals no callback set 2026-02-17T12:05:14.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f9801d47640 5 monclient: authenticate success, global_id 4217 2026-02-17T12:05:14.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f9801d47640 10 monclient: _renew_subs 2026-02-17T12:05:14.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f9801d47640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f9801d47640 1 -- 10.20.193.77:0/3160605161 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc06f500 con 0x7f97fc09be20 2026-02-17T12:05:14.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f9801d47640 10 monclient: _renew_subs 2026-02-17T12:05:14.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f9801d47640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f9801d47640 1 -- 10.20.193.77:0/3160605161 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc0a19f0 con 0x7f97fc09be20 2026-02-17T12:05:14.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f9801d47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:14.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f9801d47640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:14.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f9801d47640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f9801d47640 1 -- 10.20.193.77:0/3160605161 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97fc134fe0 con 0x7f97fc09be20 2026-02-17T12:05:14.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 1 -- 10.20.193.77:0/3160605161 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f97e8024060 con 0x7f97fc09be20 2026-02-17T12:05:14.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 1 --2- 10.20.193.77:0/3160605161 >> v2:10.20.193.119:6800/4127986552 conn(0x7f97cc03a120 0x7f97cc03c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97d7fff640 1 -- 10.20.193.77:0/3160605161 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f97e804da50 con 0x7f97fc09be20 2026-02-17T12:05:14.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97faffd640 1 --2- 10.20.193.77:0/3160605161 >> v2:10.20.193.119:6800/4127986552 conn(0x7f97cc03a120 0x7f97cc03c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97faffd640 10 monclient: get_auth_request con 0x7f97cc03a120 auth_method 0 2026-02-17T12:05:14.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.591+0000 7f97faffd640 1 --2- 10.20.193.77:0/3160605161 >> v2:10.20.193.119:6800/4127986552 conn(0x7f97cc03a120 0x7f97cc03c5e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f97fc1326a0 tx=0x7f97ec004840 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:14.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.595+0000 7f97d7fff640 1 -- 10.20.193.77:0/3160605161 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f97e8013610 con 0x7f97fc09be20 2026-02-17T12:05:14.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.595+0000 7f97d7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:14.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.595+0000 7f97d7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:14.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.687+0000 7f9801d47640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-17T12:05:14.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.687+0000 7f9801d47640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-17T12:05:14.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.687+0000 7f9801d47640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.687+0000 7f9801d47640 1 -- 10.20.193.77:0/3160605161 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f97fc12f120 con 0x7f97fc09be20 2026-02-17T12:05:14.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.687+0000 7f97d7fff640 1 -- 10.20.193.77:0/3160605161 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+91137 (secure 0 0 0) 0x7f97e80123d0 con 0x7f97fc09be20 2026-02-17T12:05:14.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.687+0000 7f97d7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-17T12:05:14.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.687+0000 7f97d7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:14.692 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:05:14.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.691+0000 7f9801d47640 1 -- 10.20.193.77:0/3160605161 >> v2:10.20.193.119:6800/4127986552 conn(0x7f97cc03a120 msgr2=0x7f97cc03c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.691+0000 7f9801d47640 1 --2- 10.20.193.77:0/3160605161 >> v2:10.20.193.119:6800/4127986552 conn(0x7f97cc03a120 0x7f97cc03c5e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f97fc1326a0 tx=0x7f97ec004840 comp rx=0 tx=0).stop 2026-02-17T12:05:14.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.691+0000 7f9801d47640 10 monclient: shutdown 2026-02-17T12:05:14.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.691+0000 7f9801d47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:14.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.691+0000 7f9801d47640 1 -- 10.20.193.77:0/3160605161 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc09be20 msgr2=0x7f97fc12e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.691+0000 7f9801d47640 1 --2- 10.20.193.77:0/3160605161 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc09be20 0x7f97fc12e6a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f97e800e9b0 tx=0x7f97e800ee70 comp rx=0 tx=0).stop 2026-02-17T12:05:14.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.691+0000 7f9801d47640 1 -- 10.20.193.77:0/3160605161 shutdown_connections 2026-02-17T12:05:14.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.691+0000 7f9801d47640 1 --2- 10.20.193.77:0/3160605161 >> v2:10.20.193.119:6800/4127986552 conn(0x7f97cc03a120 0x7f97cc03c5e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.691+0000 7f9801d47640 1 --2- 10.20.193.77:0/3160605161 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f97fc138000 0x7f97fc1d2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.691+0000 7f9801d47640 1 --2- 10.20.193.77:0/3160605161 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f97fc0a4b60 0x7f97fc12ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.691+0000 7f9801d47640 1 --2- 10.20.193.77:0/3160605161 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f97fc09be20 0x7f97fc12e6a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.691+0000 7f9801d47640 1 -- 10.20.193.77:0/3160605161 >> 10.20.193.77:0/3160605161 conn(0x7f97fc074b90 msgr2=0x7f97fc132a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:14.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.691+0000 7f9801d47640 1 -- 10.20.193.77:0/3160605161 shutdown_connections 2026-02-17T12:05:14.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.691+0000 7f9801d47640 1 -- 10.20.193.77:0/3160605161 wait complete. 2026-02-17T12:05:14.700 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6800","nonce":4127986552}]},"active_addr":"10.20.193.119:6800/4127986552","active_change":"2026-02-17T12:04:56.264978+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.119:0","nonce":70843694}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.119:0","nonce":2290301878}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.119:0","nonce":2605786070}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.119:0","nonce":2894559891}]}]} 2026-02-17T12:05:14.704 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T12:05:14.704 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T12:05:14.704 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T12:05:14.774 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.771+0000 7f397c900640 10 monclient: get_monmap_and_config 2026-02-17T12:05:14.774 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.771+0000 7f397c900640 10 monclient: build_initial_monmap 2026-02-17T12:05:14.774 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.771+0000 7f397c900640 10 monclient: monmap: 2026-02-17T12:05:14.774 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:14.775 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.775 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:14.776723+0000 2026-02-17T12:05:14.775 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:14.776723+0000 2026-02-17T12:05:14.775 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:14.775 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.775 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:14.775 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:14.775 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:14.775 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:14.775 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:14.775 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.777 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 1 Processor -- start 2026-02-17T12:05:14.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 1 -- start start 2026-02-17T12:05:14.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 10 monclient: init 2026-02-17T12:05:14.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:14.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 10 monclient: _add_conns ranks=[1,0,3,4,2] 2026-02-17T12:05:14.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f397809be20 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:14.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f39780a4c20 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:14.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f39780a5070 0x7f3978140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 10 monclient(hunting): picked mon.noname-a con 0x7f39780a5070 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:14.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3978135530 con 0x7f39780a4c20 2026-02-17T12:05:14.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397809cdf0 con 0x7f397809be20 2026-02-17T12:05:14.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:14.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f397809c200 con 0x7f39780a5070 2026-02-17T12:05:14.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:14.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f397c900640 10 monclient(hunting): authenticate will time out at 566.452542s 2026-02-17T12:05:14.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f39780a5070 0x7f3978140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3975d74640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f39780a4c20 0x7f397813d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42336/0 (socket says 10.20.193.77:42336) 2026-02-17T12:05:14.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f39780a5070 0x7f3978140ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44306/0 (socket says 10.20.193.77:44306) 2026-02-17T12:05:14.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3975d74640 1 -- 10.20.193.77:0/2028620287 learned_addr learned my addr 10.20.193.77:0/2028620287 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:14.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 10 monclient(hunting): get_auth_request con 0x7f39780a5070 auth_method 0 2026-02-17T12:05:14.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:14.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:14.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:14.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:14.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:14.780 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:14.780 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 10 monclient(hunting): handle_auth_done global_id 4227 payload 274 2026-02-17T12:05:14.780 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 1 -- 10.20.193.77:0/2028620287 >> v1:10.20.193.119:6789/0 conn(0x7f397809be20 legacy=0x7f3978134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:14.780 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 1 -- 10.20.193.77:0/2028620287 >> v1:10.20.193.77:6789/0 conn(0x7f39780a4c20 legacy=0x7f397813d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:14.780 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 10 monclient: _finish_hunting 0 2026-02-17T12:05:14.780 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 1 monclient: found mon.noname-a 2026-02-17T12:05:14.780 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:14.780 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:14.780 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.775+0000 7f3976d76640 1 -- 10.20.193.77:0/2028620287 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397809d0d0 con 0x7f39780a5070 2026-02-17T12:05:14.786 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976d76640 1 -- 10.20.193.77:0/2028620287 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f39780a5070 msgr2=0x7f3978140ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:14.786 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976d76640 1 --2- 10.20.193.77:0/2028620287 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f39780a5070 0x7f3978140ba0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3968009d90 tx=0x7f396801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b707886dc4ba9d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:14.786 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975573640 1 -- 10.20.193.77:0/2028620287 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39680b2070 con 0x7f39780a5070 2026-02-17T12:05:14.786 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:14.786 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:14.786 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975573640 10 monclient: dump: 2026-02-17T12:05:14.786 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:14.786 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.787 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.787 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.787 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:14.787 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.787 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:14.787 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:14.787 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:14.787 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.787 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975573640 10 monclient: _finish_auth 0 2026-02-17T12:05:14.787 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975573640 10 monclient: _check_auth_tickets 2026-02-17T12:05:14.787 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:14.787 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975573640 1 -- 10.20.193.77:0/2028620287 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39680a5880 con 0x7f39780a5070 2026-02-17T12:05:14.788 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 5 monclient: authenticate success, global_id 4227 2026-02-17T12:05:14.788 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:14.788 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:14.788 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975573640 1 -- 10.20.193.77:0/2028620287 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39680a5c50 con 0x7f39780a5070 2026-02-17T12:05:14.788 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:14.788 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 4 set_mon_vals no callback set 2026-02-17T12:05:14.788 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:14.788 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:14.788 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975573640 10 monclient: dump: 2026-02-17T12:05:14.788 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:14.788 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.788 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.789 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.789 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:14.789 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.789 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:14.789 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:14.789 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:14.789 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.789 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient: shutdown 2026-02-17T12:05:14.789 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:14.789 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 -- 10.20.193.77:0/2028620287 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f39780a5070 msgr2=0x7f3978140ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.789 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 --2- 10.20.193.77:0/2028620287 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f39780a5070 0x7f3978140ba0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3968009d90 tx=0x7f396801c850 comp rx=0 tx=0).stop 2026-02-17T12:05:14.789 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 -- 10.20.193.77:0/2028620287 shutdown_connections 2026-02-17T12:05:14.790 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 --2- 10.20.193.77:0/2028620287 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f39780a5070 0x7f3978140ba0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.790 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 -- 10.20.193.77:0/2028620287 >> 10.20.193.77:0/2028620287 conn(0x7f3978074ba0 msgr2=0x7f39780aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:14.790 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 -- 10.20.193.77:0/2028620287 shutdown_connections 2026-02-17T12:05:14.790 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 -- 10.20.193.77:0/2028620287 wait complete. 2026-02-17T12:05:14.790 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient: build_initial_monmap 2026-02-17T12:05:14.790 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient: monmap: 2026-02-17T12:05:14.790 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:14.790 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:14.790 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:14.790 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:14.790 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:14.790 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.790 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:14.791 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:14.791 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:14.791 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.791 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 Processor -- start 2026-02-17T12:05:14.791 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 -- start start 2026-02-17T12:05:14.791 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient: init 2026-02-17T12:05:14.791 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:14.791 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:14.791 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f397809be20 0x7f3978131c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.791 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient(hunting): picked mon.noname-b con 0x7f397809be20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:14.791 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f39780a4c20 0x7f39780a28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.791 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient(hunting): picked mon.noname-c con 0x7f39780a4c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:14.791 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f39780a5070 0x7f39780a2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient(hunting): picked mon.noname-a con 0x7f39780a5070 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:14.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:14.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3978143c90 con 0x7f39780a5070 2026-02-17T12:05:14.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:14.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3978143b10 con 0x7f397809be20 2026-02-17T12:05:14.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:14.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3978143e10 con 0x7f39780a4c20 2026-02-17T12:05:14.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:14.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient(hunting): authenticate will time out at 566.457329s 2026-02-17T12:05:14.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f39780a4c20 0x7f39780a28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976d76640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f39780a5070 0x7f39780a2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f39780a4c20 0x7f39780a28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50642/0 (socket says 10.20.193.77:50642) 2026-02-17T12:05:14.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 1 -- 10.20.193.77:0/2654152228 learned_addr learned my addr 10.20.193.77:0/2654152228 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:14.793 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 10 monclient(hunting): get_auth_request con 0x7f39780a4c20 auth_method 0 2026-02-17T12:05:14.793 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:14.793 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:14.793 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:14.793 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976d76640 10 monclient(hunting): get_auth_request con 0x7f39780a5070 auth_method 0 2026-02-17T12:05:14.793 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:14.793 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:14.793 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:14.793 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:14.793 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:14.793 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976575640 1 --2- 10.20.193.77:0/2654152228 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f397809be20 0x7f3978131c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.793 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:14.793 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976575640 10 monclient(hunting): get_auth_request con 0x7f397809be20 auth_method 0 2026-02-17T12:05:14.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:14.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:14.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:14.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:14.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:14.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3976d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:14.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 10 monclient(hunting): handle_auth_done global_id 4220 payload 824 2026-02-17T12:05:14.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 1 -- 10.20.193.77:0/2654152228 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f397809be20 msgr2=0x7f3978131c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 1 --2- 10.20.193.77:0/2654152228 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f397809be20 0x7f3978131c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 1 -- 10.20.193.77:0/2654152228 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f39780a5070 msgr2=0x7f39780a2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 1 --2- 10.20.193.77:0/2654152228 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f39780a5070 0x7f39780a2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 10 monclient: _finish_hunting 0 2026-02-17T12:05:14.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 1 monclient: found mon.noname-c 2026-02-17T12:05:14.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:14.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 1 -- 10.20.193.77:0/2654152228 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39781342e0 con 0x7f39780a4c20 2026-02-17T12:05:14.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 1 -- 10.20.193.77:0/2654152228 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f39780a4c20 msgr2=0x7f39780a28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:14.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3975d74640 1 --2- 10.20.193.77:0/2654152228 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f39780a4c20 0x7f39780a28e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f396000c5a0 tx=0x7f396000ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:14.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f395effd640 1 -- 10.20.193.77:0/2654152228 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960017070 con 0x7f39780a4c20 2026-02-17T12:05:14.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f395effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:14.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f395effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:14.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f395effd640 10 monclient: dump: 2026-02-17T12:05:14.795 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:14.795 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.795 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.795 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.796 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:14.796 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.796 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:14.796 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:14.796 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:14.796 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.796 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f395effd640 10 monclient: _finish_auth 0 2026-02-17T12:05:14.796 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f395effd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:14.796 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f395effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:14.796 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f395effd640 1 -- 10.20.193.77:0/2654152228 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3960007070 con 0x7f39780a4c20 2026-02-17T12:05:14.796 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f395effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:14.796 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f395effd640 1 -- 10.20.193.77:0/2654152228 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960007460 con 0x7f39780a4c20 2026-02-17T12:05:14.797 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f395effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:14.797 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f395effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:14.797 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f395effd640 10 monclient: dump: 2026-02-17T12:05:14.797 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:14.797 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.797 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.797 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.797 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:14.797 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.797 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:14.797 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:14.797 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:14.797 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.797 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f3974d72640 4 set_mon_vals no callback set 2026-02-17T12:05:14.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 5 monclient: authenticate success, global_id 4220 2026-02-17T12:05:14.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient: _renew_subs 2026-02-17T12:05:14.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.779+0000 7f397c900640 1 -- 10.20.193.77:0/2654152228 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39780a44e0 con 0x7f39780a4c20 2026-02-17T12:05:14.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.783+0000 7f397c900640 10 monclient: _renew_subs 2026-02-17T12:05:14.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.783+0000 7f397c900640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.783+0000 7f397c900640 1 -- 10.20.193.77:0/2654152228 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3978139600 con 0x7f39780a4c20 2026-02-17T12:05:14.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.783+0000 7f397c900640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:14.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.783+0000 7f397c900640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:14.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.783+0000 7f397c900640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.783+0000 7f397c900640 1 -- 10.20.193.77:0/2654152228 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3978134e00 con 0x7f39780a4c20 2026-02-17T12:05:14.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.783+0000 7f395effd640 1 -- 10.20.193.77:0/2654152228 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f3960007600 con 0x7f39780a4c20 2026-02-17T12:05:14.799 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.783+0000 7f395effd640 1 --2- 10.20.193.77:0/2654152228 >> v2:10.20.193.119:6800/4127986552 conn(0x7f394403a170 0x7f394403c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.799 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.783+0000 7f395effd640 1 -- 10.20.193.77:0/2654152228 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f396004d1b0 con 0x7f39780a4c20 2026-02-17T12:05:14.799 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.783+0000 7f3976575640 1 --2- 10.20.193.77:0/2654152228 >> v2:10.20.193.119:6800/4127986552 conn(0x7f394403a170 0x7f394403c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.799 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.783+0000 7f3976575640 10 monclient: get_auth_request con 0x7f394403a170 auth_method 0 2026-02-17T12:05:14.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.783+0000 7f3976575640 1 --2- 10.20.193.77:0/2654152228 >> v2:10.20.193.119:6800/4127986552 conn(0x7f394403a170 0x7f394403c630 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f396c0098f0 tx=0x7f396c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:14.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.787+0000 7f395effd640 1 -- 10.20.193.77:0/2654152228 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f396001b590 con 0x7f39780a4c20 2026-02-17T12:05:14.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.787+0000 7f395effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:14.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.787+0000 7f395effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:14.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.859+0000 7f397c900640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:14.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.859+0000 7f397c900640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:14.862 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.859+0000 7f397c900640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.859+0000 7f397c900640 1 -- 10.20.193.77:0/2654152228 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f397813a5f0 con 0x7f39780a4c20 2026-02-17T12:05:14.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f395effd640 1 -- 10.20.193.77:0/2654152228 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+10815 (secure 0 0 0) 0x7f396001bd40 con 0x7f39780a4c20 2026-02-17T12:05:14.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f395effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:14.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f395effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:14.864 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:05:14.864 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":20,"fsid":"093d53f2-7cd0-4506-a27d-4c950e190615","created":"2026-02-17T12:04:53.336611+0000","modified":"2026-02-17T12:05:14.279248+0000","last_up_change":"2026-02-17T12:05:05.953164+0000","last_in_change":"2026-02-17T12:04:55.265712+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T12:05:06.312998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T12:05:10.954009+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6780fd-cb0e-481f-8816-a32e3434b102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6800","nonce":1107649769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":1107649769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1107649769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":1107649769}]},"public_addr":"10.20.193.77:6800/1107649769","cluster_addr":"10.20.193.77:6802/1107649769","heartbeat_back_addr":"10.20.193.77:6806/1107649769","heartbeat_front_addr":"10.20.193.77:6804/1107649769","state":["exists","up"]},{"osd":1,"uuid":"a82a493e-88de-4b65-ab23-41b52ffb6b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":662135547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":662135547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":662135547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":662135547}]},"public_addr":"10.20.193.77:6801/662135547","cluster_addr":"10.20.193.77:6803/662135547","heartbeat_back_addr":"10.20.193.77:6807/662135547","heartbeat_front_addr":"10.20.193.77:6805/662135547","state":["exists","up"]},{"osd":2,"uuid":"02ae9c66-fa9e-46d2-8be5-ba695ba4763b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":3812083705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":3812083705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":3812083705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":3812083705}]},"public_addr":"10.20.193.77:6808/3812083705","cluster_addr":"10.20.193.77:6809/3812083705","heartbeat_back_addr":"10.20.193.77:6811/3812083705","heartbeat_front_addr":"10.20.193.77:6810/3812083705","state":["exists","up"]},{"osd":3,"uuid":"fe40e683-451d-4e8a-94f4-69ace432df28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6801","nonce":3041501560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6802","nonce":3041501560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6804","nonce":3041501560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6803","nonce":3041501560}]},"public_addr":"10.20.193.119:6801/3041501560","cluster_addr":"10.20.193.119:6802/3041501560","heartbeat_back_addr":"10.20.193.119:6804/3041501560","heartbeat_front_addr":"10.20.193.119:6803/3041501560","state":["exists","up"]},{"osd":4,"uuid":"e6fc84bb-bd81-49d5-8cfd-b4ab0468d8dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6805","nonce":4132502681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6806","nonce":4132502681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6808","nonce":4132502681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6807","nonce":4132502681}]},"public_addr":"10.20.193.119:6805/4132502681","cluster_addr":"10.20.193.119:6806/4132502681","heartbeat_back_addr":"10.20.193.119:6808/4132502681","heartbeat_front_addr":"10.20.193.119:6807/4132502681","state":["exists","up"]},{"osd":5,"uuid":"400ef2a1-c8ee-4376-b3d9-588e2a34ad9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6809","nonce":3174335982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6810","nonce":3174335982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6812","nonce":3174335982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6811","nonce":3174335982}]},"public_addr":"10.20.193.119:6809/3174335982","cluster_addr":"10.20.193.119:6810/3174335982","heartbeat_back_addr":"10.20.193.119:6812/3174335982","heartbeat_front_addr":"10.20.193.119:6811/3174335982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:05:14.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f397c900640 1 -- 10.20.193.77:0/2654152228 >> v2:10.20.193.119:6800/4127986552 conn(0x7f394403a170 msgr2=0x7f394403c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f397c900640 1 --2- 10.20.193.77:0/2654152228 >> v2:10.20.193.119:6800/4127986552 conn(0x7f394403a170 0x7f394403c630 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f396c0098f0 tx=0x7f396c008040 comp rx=0 tx=0).stop 2026-02-17T12:05:14.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f397c900640 10 monclient: shutdown 2026-02-17T12:05:14.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f397c900640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:14.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f397c900640 1 -- 10.20.193.77:0/2654152228 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f39780a4c20 msgr2=0x7f39780a28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f397c900640 1 --2- 10.20.193.77:0/2654152228 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f39780a4c20 0x7f39780a28e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f396000c5a0 tx=0x7f396000ca60 comp rx=0 tx=0).stop 2026-02-17T12:05:14.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f397c900640 1 -- 10.20.193.77:0/2654152228 shutdown_connections 2026-02-17T12:05:14.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f397c900640 1 --2- 10.20.193.77:0/2654152228 >> v2:10.20.193.119:6800/4127986552 conn(0x7f394403a170 0x7f394403c630 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f397c900640 1 --2- 10.20.193.77:0/2654152228 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f39780a5070 0x7f39780a2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f397c900640 1 --2- 10.20.193.77:0/2654152228 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f39780a4c20 0x7f39780a28e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f397c900640 1 --2- 10.20.193.77:0/2654152228 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f397809be20 0x7f3978131c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f397c900640 1 -- 10.20.193.77:0/2654152228 >> 10.20.193.77:0/2654152228 conn(0x7f3978074ba0 msgr2=0x7f3978137db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:14.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f397c900640 1 -- 10.20.193.77:0/2654152228 shutdown_connections 2026-02-17T12:05:14.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.863+0000 7f397c900640 1 -- 10.20.193.77:0/2654152228 wait complete. 2026-02-17T12:05:14.873 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T12:05:14.873 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T12:05:14.934 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.931+0000 7f8f16451640 10 monclient: get_monmap_and_config 2026-02-17T12:05:14.934 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.931+0000 7f8f16451640 10 monclient: build_initial_monmap 2026-02-17T12:05:14.934 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.931+0000 7f8f16451640 10 monclient: monmap: 2026-02-17T12:05:14.934 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:14.934 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.934 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:14.936721+0000 2026-02-17T12:05:14.935 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:14.936721+0000 2026-02-17T12:05:14.935 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:14.935 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.935 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:14.935 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:14.935 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:14.935 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:14.935 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:14.935 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.931+0000 7f8f16451640 1 Processor -- start 2026-02-17T12:05:14.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.931+0000 7f8f16451640 1 -- start start 2026-02-17T12:05:14.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.931+0000 7f8f16451640 10 monclient: init 2026-02-17T12:05:14.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f16451640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:14.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f16451640 10 monclient: _add_conns ranks=[3,1,4,0,2] 2026-02-17T12:05:14.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f16451640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f8f1009c420 0x7f8f100a2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f16451640 10 monclient(hunting): picked mon.noname-a con 0x7f8f1009c420 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:14.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f16451640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8f100a2750 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:14.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f16451640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f8f100a2b80 0x7f8f1013d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f16451640 10 monclient(hunting): picked mon.noname-c con 0x7f8f100a2b80 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:14.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f16451640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f1009ffa0 con 0x7f8f100a2750 2026-02-17T12:05:14.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f16451640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:14.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f16451640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1009f3e0 con 0x7f8f1009c420 2026-02-17T12:05:14.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f16451640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:14.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f16451640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1009acc0 con 0x7f8f100a2b80 2026-02-17T12:05:14.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f16451640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:14.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f16451640 10 monclient(hunting): authenticate will time out at 566.612328s 2026-02-17T12:05:14.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f8f1009c420 0x7f8f100a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f8f1009c420 0x7f8f100a2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44324/0 (socket says 10.20.193.77:44324) 2026-02-17T12:05:14.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 1 -- 10.20.193.77:0/34070963 learned_addr learned my addr 10.20.193.77:0/34070963 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:14.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 10 monclient(hunting): get_auth_request con 0x7f8f1009c420 auth_method 0 2026-02-17T12:05:14.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:14.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:14.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:14.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:14.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:14.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:14.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f149c7640 1 --2- 10.20.193.77:0/34070963 >> v2:10.20.193.119:3300/0 conn(0x7f8f100a2b80 0x7f8f1013d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f149c7640 10 monclient(hunting): get_auth_request con 0x7f8f100a2b80 auth_method 0 2026-02-17T12:05:14.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f149c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:14.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f149c7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:14.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f149c7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:14.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 10 monclient(hunting): handle_auth_done global_id 4233 payload 274 2026-02-17T12:05:14.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 1 -- 10.20.193.77:0/34070963 >> v2:10.20.193.119:3300/0 conn(0x7f8f100a2b80 msgr2=0x7f8f1013d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:14.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 1 --2- 10.20.193.77:0/34070963 >> v2:10.20.193.119:3300/0 conn(0x7f8f100a2b80 0x7f8f1013d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 1 -- 10.20.193.77:0/34070963 >> v1:10.20.193.119:6789/0 conn(0x7f8f100a2750 legacy=0x7f8f10139980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:14.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:14.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 1 monclient: found mon.noname-a 2026-02-17T12:05:14.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:14.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:14.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 1 -- 10.20.193.77:0/34070963 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1009f860 con 0x7f8f1009c420 2026-02-17T12:05:14.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 1 -- 10.20.193.77:0/34070963 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f8f1009c420 msgr2=0x7f8f100a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:14.942 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0ffff640 1 --2- 10.20.193.77:0/34070963 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f8f1009c420 0x7f8f100a2210 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8f1009f140 tx=0x7f8efc01c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca04c084d3eb2f9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:14.947 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0effd640 1 -- 10.20.193.77:0/34070963 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc0b0070 con 0x7f8f1009c420 2026-02-17T12:05:14.947 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:14.947 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:14.947 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.935+0000 7f8f0effd640 10 monclient: dump: 2026-02-17T12:05:14.947 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:14.947 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.947 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.947 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.947 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:14.948 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.948 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:14.948 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:14.948 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:14.948 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.948 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0effd640 10 monclient: _finish_auth 0 2026-02-17T12:05:14.948 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0effd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:14.948 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:14.948 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0effd640 1 -- 10.20.193.77:0/34070963 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8efc004230 con 0x7f8f1009c420 2026-02-17T12:05:14.948 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 5 monclient: authenticate success, global_id 4233 2026-02-17T12:05:14.948 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:14.948 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:14.949 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0effd640 1 -- 10.20.193.77:0/34070963 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc003720 con 0x7f8f1009c420 2026-02-17T12:05:14.949 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:14.949 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:14.949 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0effd640 10 monclient: dump: 2026-02-17T12:05:14.949 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:14.949 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.949 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.949 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.949 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:14.949 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.949 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:14.949 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:14.949 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:14.950 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.950 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:14.950 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 4 set_mon_vals no callback set 2026-02-17T12:05:14.950 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient: shutdown 2026-02-17T12:05:14.950 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:14.950 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 -- 10.20.193.77:0/34070963 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f8f1009c420 msgr2=0x7f8f100a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.950 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 --2- 10.20.193.77:0/34070963 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f8f1009c420 0x7f8f100a2210 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8f1009f140 tx=0x7f8efc01c590 comp rx=0 tx=0).stop 2026-02-17T12:05:14.950 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 -- 10.20.193.77:0/34070963 shutdown_connections 2026-02-17T12:05:14.950 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 --2- 10.20.193.77:0/34070963 >> v2:10.20.193.119:3300/0 conn(0x7f8f100a2b80 0x7f8f1013d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.950 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 --2- 10.20.193.77:0/34070963 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f8f1009c420 0x7f8f100a2210 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.950 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 -- 10.20.193.77:0/34070963 >> 10.20.193.77:0/34070963 conn(0x7f8f100a73c0 msgr2=0x7f8f100a3300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:14.950 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 -- 10.20.193.77:0/34070963 shutdown_connections 2026-02-17T12:05:14.951 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 -- 10.20.193.77:0/34070963 wait complete. 2026-02-17T12:05:14.951 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient: build_initial_monmap 2026-02-17T12:05:14.951 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient: monmap: 2026-02-17T12:05:14.951 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:14.951 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:14.951 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:14.951 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:14.951 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:14.951 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.951 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:14.951 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:14.952 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:14.952 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.952 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 Processor -- start 2026-02-17T12:05:14.952 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 -- start start 2026-02-17T12:05:14.952 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient: init 2026-02-17T12:05:14.952 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:14.952 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:05:14.952 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f8f1009c420 0x7f8f10098d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.952 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient(hunting): picked mon.noname-c con 0x7f8f1009c420 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:14.952 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f8f100a2750 0x7f8f10094a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.952 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient(hunting): picked mon.noname-a con 0x7f8f100a2750 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:14.953 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8f100a2b80 0x7f8f10094fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.953 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient(hunting): picked mon.noname-b con 0x7f8f100a2b80 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:14.953 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:14.953 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8f100a01c0 con 0x7f8f100a2750 2026-02-17T12:05:14.953 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:14.953 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8f100a40d0 con 0x7f8f100a2b80 2026-02-17T12:05:14.953 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:14.953 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8f100a0340 con 0x7f8f1009c420 2026-02-17T12:05:14.953 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:14.953 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f16451640 10 monclient(hunting): authenticate will time out at 566.617741s 2026-02-17T12:05:14.953 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f8f1009c420 0x7f8f10098d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.953 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f8f1009c420 0x7f8f10098d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50658/0 (socket says 10.20.193.77:50658) 2026-02-17T12:05:14.953 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 1 -- 10.20.193.77:0/3143700062 learned_addr learned my addr 10.20.193.77:0/3143700062 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:14.954 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 10 monclient(hunting): get_auth_request con 0x7f8f1009c420 auth_method 0 2026-02-17T12:05:14.954 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:14.954 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:14.954 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:14.954 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0f7fe640 1 --2- 10.20.193.77:0/3143700062 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f8f100a2750 0x7f8f10094a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.954 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:14.954 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:14.954 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:14.954 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0f7fe640 10 monclient(hunting): get_auth_request con 0x7f8f100a2750 auth_method 0 2026-02-17T12:05:14.954 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:14.954 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:14.954 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:14.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f149c7640 1 --2- 10.20.193.77:0/3143700062 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8f100a2b80 0x7f8f10094fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:14.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:14.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:14.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f149c7640 10 monclient(hunting): get_auth_request con 0x7f8f100a2b80 auth_method 0 2026-02-17T12:05:14.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f149c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:14.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f149c7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:14.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f149c7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:14.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 10 monclient(hunting): handle_auth_done global_id 4223 payload 824 2026-02-17T12:05:14.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 1 -- 10.20.193.77:0/3143700062 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8f100a2b80 msgr2=0x7f8f10094fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 1 --2- 10.20.193.77:0/3143700062 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8f100a2b80 0x7f8f10094fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 1 -- 10.20.193.77:0/3143700062 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f8f100a2750 msgr2=0x7f8f10094a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:14.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 1 --2- 10.20.193.77:0/3143700062 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f8f100a2750 0x7f8f10094a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:14.956 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:14.956 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 1 monclient: found mon.noname-c 2026-02-17T12:05:14.956 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:14.956 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.956 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.939+0000 7f8f0ffff640 1 -- 10.20.193.77:0/3143700062 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f10098670 con 0x7f8f1009c420 2026-02-17T12:05:14.956 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0ffff640 1 -- 10.20.193.77:0/3143700062 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f8f1009c420 msgr2=0x7f8f10098d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:14.956 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0ffff640 1 --2- 10.20.193.77:0/3143700062 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f8f1009c420 0x7f8f10098d70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8efc002420 tx=0x7f8efc019330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:14.956 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 1 -- 10.20.193.77:0/3143700062 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc0bb070 con 0x7f8f1009c420 2026-02-17T12:05:14.956 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:14.956 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:14.956 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 10 monclient: dump: 2026-02-17T12:05:14.956 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:14.956 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.957 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.957 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.957 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:14.957 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.957 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:14.957 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:14.957 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:14.957 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.957 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 10 monclient: _finish_auth 0 2026-02-17T12:05:14.957 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 10 monclient: _check_auth_tickets 2026-02-17T12:05:14.957 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:14.957 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 1 -- 10.20.193.77:0/3143700062 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8efc003c30 con 0x7f8f1009c420 2026-02-17T12:05:14.958 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:14.958 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 1 -- 10.20.193.77:0/3143700062 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc0b0040 con 0x7f8f1009c420 2026-02-17T12:05:14.958 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:14.958 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:14.958 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 10 monclient: dump: 2026-02-17T12:05:14.958 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:14.958 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:14.958 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.958 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:14.958 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:14.958 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:14.958 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:14.958 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:14.958 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:14.959 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:14.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0e7fc640 4 set_mon_vals no callback set 2026-02-17T12:05:14.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f16451640 5 monclient: authenticate success, global_id 4223 2026-02-17T12:05:14.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f16451640 10 monclient: _renew_subs 2026-02-17T12:05:14.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f16451640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f16451640 1 -- 10.20.193.77:0/3143700062 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f10098950 con 0x7f8f1009c420 2026-02-17T12:05:14.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f16451640 10 monclient: _renew_subs 2026-02-17T12:05:14.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f16451640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f16451640 1 -- 10.20.193.77:0/3143700062 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f10098390 con 0x7f8f1009c420 2026-02-17T12:05:14.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f16451640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:14.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f16451640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:14.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f16451640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:14.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f16451640 1 -- 10.20.193.77:0/3143700062 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f100a5d60 con 0x7f8f1009c420 2026-02-17T12:05:14.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 1 -- 10.20.193.77:0/3143700062 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f8efc0b6470 con 0x7f8f1009c420 2026-02-17T12:05:14.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 1 --2- 10.20.193.77:0/3143700062 >> v2:10.20.193.119:6800/4127986552 conn(0x7f8ee003a120 0x7f8ee003c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:14.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0cff9640 1 -- 10.20.193.77:0/3143700062 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f8efc0e71e0 con 0x7f8f1009c420 2026-02-17T12:05:14.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0f7fe640 1 --2- 10.20.193.77:0/3143700062 >> v2:10.20.193.119:6800/4127986552 conn(0x7f8ee003a120 0x7f8ee003c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:14.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0f7fe640 10 monclient: get_auth_request con 0x7f8ee003a120 auth_method 0 2026-02-17T12:05:14.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.943+0000 7f8f0f7fe640 1 --2- 10.20.193.77:0/3143700062 >> v2:10.20.193.119:6800/4127986552 conn(0x7f8ee003a120 0x7f8ee003c5e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8f10098880 tx=0x7f8f00007f40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:14.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.947+0000 7f8f0cff9640 1 -- 10.20.193.77:0/3143700062 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f8efc016210 con 0x7f8f1009c420 2026-02-17T12:05:14.961 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.947+0000 7f8f0cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:14.961 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:14.947+0000 7f8f0cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:15.025 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:15.026 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:15.026 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.026 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 1 -- 10.20.193.77:0/3143700062 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f100a2190 con 0x7f8f1009c420 2026-02-17T12:05:15.026 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f0cff9640 1 -- 10.20.193.77:0/3143700062 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+10815 (secure 0 0 0) 0x7f8efc0aade0 con 0x7f8f1009c420 2026-02-17T12:05:15.026 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f0cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:15.026 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f0cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:15.027 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:05:15.027 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":20,"fsid":"093d53f2-7cd0-4506-a27d-4c950e190615","created":"2026-02-17T12:04:53.336611+0000","modified":"2026-02-17T12:05:14.279248+0000","last_up_change":"2026-02-17T12:05:05.953164+0000","last_in_change":"2026-02-17T12:04:55.265712+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T12:05:06.312998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T12:05:10.954009+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6780fd-cb0e-481f-8816-a32e3434b102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6800","nonce":1107649769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":1107649769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1107649769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":1107649769}]},"public_addr":"10.20.193.77:6800/1107649769","cluster_addr":"10.20.193.77:6802/1107649769","heartbeat_back_addr":"10.20.193.77:6806/1107649769","heartbeat_front_addr":"10.20.193.77:6804/1107649769","state":["exists","up"]},{"osd":1,"uuid":"a82a493e-88de-4b65-ab23-41b52ffb6b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":662135547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":662135547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":662135547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":662135547}]},"public_addr":"10.20.193.77:6801/662135547","cluster_addr":"10.20.193.77:6803/662135547","heartbeat_back_addr":"10.20.193.77:6807/662135547","heartbeat_front_addr":"10.20.193.77:6805/662135547","state":["exists","up"]},{"osd":2,"uuid":"02ae9c66-fa9e-46d2-8be5-ba695ba4763b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":3812083705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":3812083705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":3812083705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":3812083705}]},"public_addr":"10.20.193.77:6808/3812083705","cluster_addr":"10.20.193.77:6809/3812083705","heartbeat_back_addr":"10.20.193.77:6811/3812083705","heartbeat_front_addr":"10.20.193.77:6810/3812083705","state":["exists","up"]},{"osd":3,"uuid":"fe40e683-451d-4e8a-94f4-69ace432df28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6801","nonce":3041501560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6802","nonce":3041501560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6804","nonce":3041501560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6803","nonce":3041501560}]},"public_addr":"10.20.193.119:6801/3041501560","cluster_addr":"10.20.193.119:6802/3041501560","heartbeat_back_addr":"10.20.193.119:6804/3041501560","heartbeat_front_addr":"10.20.193.119:6803/3041501560","state":["exists","up"]},{"osd":4,"uuid":"e6fc84bb-bd81-49d5-8cfd-b4ab0468d8dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6805","nonce":4132502681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6806","nonce":4132502681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6808","nonce":4132502681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6807","nonce":4132502681}]},"public_addr":"10.20.193.119:6805/4132502681","cluster_addr":"10.20.193.119:6806/4132502681","heartbeat_back_addr":"10.20.193.119:6808/4132502681","heartbeat_front_addr":"10.20.193.119:6807/4132502681","state":["exists","up"]},{"osd":5,"uuid":"400ef2a1-c8ee-4376-b3d9-588e2a34ad9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6809","nonce":3174335982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6810","nonce":3174335982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6812","nonce":3174335982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6811","nonce":3174335982}]},"public_addr":"10.20.193.119:6809/3174335982","cluster_addr":"10.20.193.119:6810/3174335982","heartbeat_back_addr":"10.20.193.119:6812/3174335982","heartbeat_front_addr":"10.20.193.119:6811/3174335982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:05:15.028 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 1 -- 10.20.193.77:0/3143700062 >> v2:10.20.193.119:6800/4127986552 conn(0x7f8ee003a120 msgr2=0x7f8ee003c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.028 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 1 --2- 10.20.193.77:0/3143700062 >> v2:10.20.193.119:6800/4127986552 conn(0x7f8ee003a120 0x7f8ee003c5e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8f10098880 tx=0x7f8f00007f40 comp rx=0 tx=0).stop 2026-02-17T12:05:15.028 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 10 monclient: shutdown 2026-02-17T12:05:15.028 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.028 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 1 -- 10.20.193.77:0/3143700062 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f8f1009c420 msgr2=0x7f8f10098d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.028 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 1 --2- 10.20.193.77:0/3143700062 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f8f1009c420 0x7f8f10098d70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8efc002420 tx=0x7f8efc019330 comp rx=0 tx=0).stop 2026-02-17T12:05:15.028 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 1 -- 10.20.193.77:0/3143700062 shutdown_connections 2026-02-17T12:05:15.028 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 1 --2- 10.20.193.77:0/3143700062 >> v2:10.20.193.119:6800/4127986552 conn(0x7f8ee003a120 0x7f8ee003c5e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.028 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 1 --2- 10.20.193.77:0/3143700062 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f8f100a2b80 0x7f8f10094fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.029 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 1 --2- 10.20.193.77:0/3143700062 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f8f100a2750 0x7f8f10094a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.029 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 1 --2- 10.20.193.77:0/3143700062 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f8f1009c420 0x7f8f10098d70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.029 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 1 -- 10.20.193.77:0/3143700062 >> 10.20.193.77:0/3143700062 conn(0x7f8f100a73c0 msgr2=0x7f8f10071640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.029 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 1 -- 10.20.193.77:0/3143700062 shutdown_connections 2026-02-17T12:05:15.029 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.023+0000 7f8f16451640 1 -- 10.20.193.77:0/3143700062 wait complete. 2026-02-17T12:05:15.037 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T12:05:15.037 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T12:05:15.038 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T12:05:15.038 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T12:05:15.039 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-17T12:05:15.039 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-17T12:05:15.099 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 10 monclient: get_monmap_and_config 2026-02-17T12:05:15.100 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.100 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 10 monclient: monmap: 2026-02-17T12:05:15.100 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.100 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.100 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:15.102140+0000 2026-02-17T12:05:15.100 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:15.102140+0000 2026-02-17T12:05:15.100 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.100 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.100 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:15.100 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:15.101 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:15.101 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:15.101 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:15.101 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.101 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 10 monclient: get_monmap_and_config 2026-02-17T12:05:15.102 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.102 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 10 monclient: monmap: 2026-02-17T12:05:15.102 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.102 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.102 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:15.102140+0000 2026-02-17T12:05:15.102 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:15.102140+0000 2026-02-17T12:05:15.103 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.103 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.103 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:15.103 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:15.103 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:15.103 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:15.103 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:15.103 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 1 Processor -- start 2026-02-17T12:05:15.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 1 -- start start 2026-02-17T12:05:15.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 10 monclient: init 2026-02-17T12:05:15.104 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 1 Processor -- start 2026-02-17T12:05:15.104 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 1 -- start start 2026-02-17T12:05:15.104 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 10 monclient: init 2026-02-17T12:05:15.105 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.106 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 10 monclient: _add_conns ranks=[4,1,0,3,2] 2026-02-17T12:05:15.106 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fb8440a3220 0x7fb84406c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.106 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 10 monclient(hunting): picked mon.noname-c con 0x7fb8440a3220 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:15.106 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb8440a39e0 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:15.106 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb8440a0200 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:15.106 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb84409f540 con 0x7fb8440a0200 2026-02-17T12:05:15.106 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb84409f820 con 0x7fb8440a39e0 2026-02-17T12:05:15.106 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.106 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fb8440a1d60 con 0x7fb8440a3220 2026-02-17T12:05:15.106 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.106 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb84a4c8640 10 monclient(hunting): authenticate will time out at 566.777628s 2026-02-17T12:05:15.107 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb848a3e640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7fb8440a0200 0x7fb84413f9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42344/0 (socket says 10.20.193.77:42344) 2026-02-17T12:05:15.107 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb848a3e640 1 -- 10.20.193.77:0/653612929 learned_addr learned my addr 10.20.193.77:0/653612929 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:15.107 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.108 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 10 monclient: _add_conns ranks=[3,1,4,0,2] 2026-02-17T12:05:15.108 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fbcf409be20 0x7fbcf4134e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.108 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 1 --2- 10.20.193.77:0/653612929 >> v2:10.20.193.119:3300/0 conn(0x7fb8440a3220 0x7fb84406c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.109 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 10 monclient(hunting): picked mon.noname-a con 0x7fbcf409be20 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:15.109 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbcf40a4c20 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:15.109 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fbcf40a5070 0x7fbcf4138800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.109 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 10 monclient(hunting): picked mon.noname-c con 0x7fbcf40a5070 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:15.109 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 10 monclient(hunting): get_auth_request con 0x7fb8440a3220 auth_method 0 2026-02-17T12:05:15.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf409cdf0 con 0x7fbcf40a4c20 2026-02-17T12:05:15.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf409c200 con 0x7fbcf409be20 2026-02-17T12:05:15.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf409d0d0 con 0x7fbcf40a5070 2026-02-17T12:05:15.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcfaa0c640 10 monclient(hunting): authenticate will time out at 566.777960s 2026-02-17T12:05:15.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fbcf409be20 0x7fbcf4134e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fbcf409be20 0x7fbcf4134e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44356/0 (socket says 10.20.193.77:44356) 2026-02-17T12:05:15.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 1 -- 10.20.193.77:0/2878706111 learned_addr learned my addr 10.20.193.77:0/2878706111 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 10 monclient(hunting): get_auth_request con 0x7fbcf409be20 auth_method 0 2026-02-17T12:05:15.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.114 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.114 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.114 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.114 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 10 monclient(hunting): handle_auth_done global_id 4239 payload 274 2026-02-17T12:05:15.114 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf8f82640 1 --2- 10.20.193.77:0/2878706111 >> v2:10.20.193.119:3300/0 conn(0x7fbcf40a5070 0x7fbcf4138800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.114 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 1 -- 10.20.193.77:0/2878706111 >> v2:10.20.193.119:3300/0 conn(0x7fbcf40a5070 msgr2=0x7fbcf4138800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.115 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 1 --2- 10.20.193.77:0/2878706111 >> v2:10.20.193.119:3300/0 conn(0x7fbcf40a5070 0x7fbcf4138800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.115 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 1 -- 10.20.193.77:0/2878706111 >> v1:10.20.193.119:6789/0 conn(0x7fbcf40a4c20 legacy=0x7fbcf41380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.115 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.115 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 1 monclient: found mon.noname-a 2026-02-17T12:05:15.115 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.115 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.115 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fbcf3fff640 1 -- 10.20.193.77:0/2878706111 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf409d3b0 con 0x7fbcf409be20 2026-02-17T12:05:15.116 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 10 monclient(hunting): handle_auth_done global_id 4216 payload 274 2026-02-17T12:05:15.116 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 1 -- 10.20.193.77:0/653612929 >> v1:10.20.193.119:6789/0 conn(0x7fb8440a39e0 legacy=0x7fb84406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.116 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 1 -- 10.20.193.77:0/653612929 >> v1:10.20.193.77:6789/0 conn(0x7fb8440a0200 legacy=0x7fb84413f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.116 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.116 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 1 monclient: found mon.noname-c 2026-02-17T12:05:15.116 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.116 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.119:3300/0 2026-02-17T12:05:15.116 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7fb843fff640 1 -- 10.20.193.77:0/653612929 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8440a3600 con 0x7fb8440a3220 2026-02-17T12:05:15.117 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7f4b7cb4e640 10 monclient: get_monmap_and_config 2026-02-17T12:05:15.117 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7f4b7cb4e640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.117 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7f4b7cb4e640 10 monclient: monmap: 2026-02-17T12:05:15.117 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.118 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.118 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:15.104956+0000 2026-02-17T12:05:15.118 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:15.104956+0000 2026-02-17T12:05:15.118 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.118 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.118 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:15.118 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:15.118 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:15.118 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:15.118 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:15.118 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.119 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7ffb51ecf640 10 monclient: get_monmap_and_config 2026-02-17T12:05:15.119 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7ffb51ecf640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.119 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.099+0000 7ffb51ecf640 10 monclient: monmap: 2026-02-17T12:05:15.119 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.120 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.120 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:15.105168+0000 2026-02-17T12:05:15.120 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:15.105168+0000 2026-02-17T12:05:15.120 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.120 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.120 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:15.120 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:15.120 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:15.120 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:15.120 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:15.120 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 1 Processor -- start 2026-02-17T12:05:15.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 1 -- start start 2026-02-17T12:05:15.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 10 monclient: init 2026-02-17T12:05:15.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 10 monclient: _add_conns ranks=[0,4,3,1,2] 2026-02-17T12:05:15.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4b780a1f20 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:15.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f4b780a2a10 0x7f4b7809cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 10 monclient(hunting): picked mon.noname-c con 0x7f4b780a2a10 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:15.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f4b7813d6d0 0x7f4b7813fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 10 monclient(hunting): picked mon.noname-a con 0x7f4b7813d6d0 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:15.123 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 1 Processor -- start 2026-02-17T12:05:15.123 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b780a3010 con 0x7f4b780a1f20 2026-02-17T12:05:15.123 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.123 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4b7809bb90 con 0x7f4b7813d6d0 2026-02-17T12:05:15.123 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f4b7809b8b0 con 0x7f4b780a2a10 2026-02-17T12:05:15.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b7cb4e640 10 monclient(hunting): authenticate will time out at 566.780419s 2026-02-17T12:05:15.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 1 -- start start 2026-02-17T12:05:15.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 10 monclient: init 2026-02-17T12:05:15.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f4b780a2a10 0x7f4b7809cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f4b780a2a10 0x7f4b7809cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.77:40470/0 (socket says 10.20.193.77:40470) 2026-02-17T12:05:15.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 1 -- 10.20.193.77:0/3922067887 learned_addr learned my addr 10.20.193.77:0/3922067887 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 10 monclient(hunting): get_auth_request con 0x7f4b780a2a10 auth_method 0 2026-02-17T12:05:15.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-17T12:05:15.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ffb4c0a3290 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:15.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7ffb4c0a3670 0x7ffb4c0a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 10 monclient(hunting): picked mon.noname-c con 0x7ffb4c0a3670 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:15.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ffb4c13b510 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:15.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb4c0a4a40 con 0x7ffb4c13b510 2026-02-17T12:05:15.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb4c072ee0 con 0x7ffb4c0a3290 2026-02-17T12:05:15.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7ffb4c0731c0 con 0x7ffb4c0a3670 2026-02-17T12:05:15.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb51ecf640 10 monclient(hunting): authenticate will time out at 566.780852s 2026-02-17T12:05:15.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 10 monclient(hunting): handle_auth_done global_id 4219 payload 274 2026-02-17T12:05:15.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 1 -- 10.20.193.77:0/3922067887 >> v2:10.20.193.77:3300/0 conn(0x7f4b7813d6d0 msgr2=0x7f4b7813fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 1 --2- 10.20.193.77:0/3922067887 >> v2:10.20.193.77:3300/0 conn(0x7f4b7813d6d0 0x7f4b7813fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 1 -- 10.20.193.77:0/3922067887 >> v1:10.20.193.77:6789/0 conn(0x7f4b780a1f20 legacy=0x7f4b780a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 1 monclient: found mon.noname-c 2026-02-17T12:05:15.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.119:3300/0 2026-02-17T12:05:15.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f4b76ffd640 1 -- 10.20.193.77:0/3922067887 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7809be70 con 0x7f4b780a2a10 2026-02-17T12:05:15.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf3fff640 1 -- 10.20.193.77:0/2878706111 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbcf409be20 msgr2=0x7fbcf4134e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf3fff640 1 --2- 10.20.193.77:0/2878706111 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbcf409be20 0x7fbcf4134e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40aba30 tx=0x7fbce001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5095eafe82978253 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4bfff640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7ffb4c13b510 0x7ffb4c13d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42360/0 (socket says 10.20.193.77:42360) 2026-02-17T12:05:15.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4bfff640 1 -- 10.20.193.77:0/2183496461 learned_addr learned my addr 10.20.193.77:0/2183496461 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:15.133 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf2ffd640 1 -- 10.20.193.77:0/2878706111 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce00b1070 con 0x7fbcf409be20 2026-02-17T12:05:15.133 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.133 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:15.133 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf2ffd640 10 monclient: dump: 2026-02-17T12:05:15.133 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.133 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.133 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.133 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.134 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.134 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.134 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.134 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.134 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.134 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf2ffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf2ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf2ffd640 1 -- 10.20.193.77:0/2878706111 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce0004230 con 0x7fbcf409be20 2026-02-17T12:05:15.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 5 monclient: authenticate success, global_id 4239 2026-02-17T12:05:15.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:15.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf2ffd640 1 -- 10.20.193.77:0/2878706111 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce00a8050 con 0x7fbcf409be20 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 4 set_mon_vals no callback set 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf2ffd640 10 monclient: dump: 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.135 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient: shutdown 2026-02-17T12:05:15.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/2878706111 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbcf409be20 msgr2=0x7fbcf4134e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 --2- 10.20.193.77:0/2878706111 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbcf409be20 0x7fbcf4134e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40aba30 tx=0x7fbce001c500 comp rx=0 tx=0).stop 2026-02-17T12:05:15.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/2878706111 shutdown_connections 2026-02-17T12:05:15.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 --2- 10.20.193.77:0/2878706111 >> v2:10.20.193.119:3300/0 conn(0x7fbcf40a5070 0x7fbcf4138800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 --2- 10.20.193.77:0/2878706111 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbcf409be20 0x7fbcf4134e20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/2878706111 >> 10.20.193.77:0/2878706111 conn(0x7fbcf4074ba0 msgr2=0x7fbcf40aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/2878706111 shutdown_connections 2026-02-17T12:05:15.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/2878706111 wait complete. 2026-02-17T12:05:15.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient: monmap: 2026-02-17T12:05:15.136 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.136 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:15.136 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:15.137 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:15.137 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.137 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.137 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:15.137 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:15.137 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:15.137 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 Processor -- start 2026-02-17T12:05:15.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 -- start start 2026-02-17T12:05:15.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient: init 2026-02-17T12:05:15.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fb843fff640 1 -- 10.20.193.77:0/653612929 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8440a3220 msgr2=0x7fb84406c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fb843fff640 1 --2- 10.20.193.77:0/653612929 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8440a3220 0x7fb84406c8e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb8300098c0 tx=0x7fb83001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dda84b92315543b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 1 --2- 10.20.193.77:0/2183496461 >> v2:10.20.193.119:3300/0 conn(0x7ffb4c0a3670 0x7ffb4c0a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 10 monclient(hunting): get_auth_request con 0x7ffb4c0a3670 auth_method 0 2026-02-17T12:05:15.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:15.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbcf409be20 0x7fbcf41d2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient(hunting): picked mon.noname-b con 0x7fbcf409be20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:15.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbcf40a4c20 0x7fbcf41d2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient(hunting): picked mon.noname-c con 0x7fbcf40a4c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.140 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbcf40a5070 0x7fbcf41d2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.140 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient(hunting): picked mon.noname-a con 0x7fbcf40a5070 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:15.140 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.140 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.140 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf4138f50 con 0x7fbcf40a5070 2026-02-17T12:05:15.140 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.140 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.141 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.141 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf4142ec0 con 0x7fbcf409be20 2026-02-17T12:05:15.141 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.141 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf4143040 con 0x7fbcf40a4c20 2026-02-17T12:05:15.141 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.141 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcfaa0c640 10 monclient(hunting): authenticate will time out at 566.782918s 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf8f82640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbcf40a5070 0x7fbcf41d2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf8f82640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbcf40a5070 0x7fbcf41d2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44360/0 (socket says 10.20.193.77:44360) 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf8f82640 1 -- 10.20.193.77:0/4285852188 learned_addr learned my addr 10.20.193.77:0/4285852188 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf8f82640 10 monclient(hunting): get_auth_request con 0x7fbcf40a5070 auth_method 0 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf8f82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf8f82640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf8f82640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 1 --2- 10.20.193.77:0/4285852188 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbcf40a4c20 0x7fbcf41d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 10 monclient(hunting): get_auth_request con 0x7fbcf40a4c20 auth_method 0 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf8f82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf8f82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.142 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 10 monclient(hunting): handle_auth_done global_id 4222 payload 274 2026-02-17T12:05:15.143 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf8f82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.143 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.143 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.143 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 1 -- 10.20.193.77:0/2183496461 >> v1:10.20.193.119:6789/0 conn(0x7ffb4c0a3290 legacy=0x7ffb4c073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.143 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 1 -- 10.20.193.77:0/2183496461 >> v1:10.20.193.77:6789/0 conn(0x7ffb4c13b510 legacy=0x7ffb4c13d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.144 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.144 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf8f82640 1 -- 10.20.193.77:0/4285852188 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbcf40a5070 msgr2=0x7fbcf41d2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:05:15.144 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf8f82640 1 -- 10.20.193.77:0/4285852188 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbcf40a5070 msgr2=0x7fbcf41d2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:05:15.144 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf8f82640 1 --2- 10.20.193.77:0/4285852188 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbcf40a5070 0x7fbcf41d2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:15.144 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.144 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 1 monclient: found mon.noname-c 2026-02-17T12:05:15.144 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.144 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.119:3300/0 2026-02-17T12:05:15.144 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7ffb4affd640 1 -- 10.20.193.77:0/2183496461 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4c0a4760 con 0x7ffb4c0a3670 2026-02-17T12:05:15.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf8f82640 1 --2- 10.20.193.77:0/4285852188 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbcf40a5070 0x7fbcf41d2eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:15.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 10 monclient(hunting): handle_auth_done global_id 4226 payload 824 2026-02-17T12:05:15.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 1 -- 10.20.193.77:0/4285852188 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbcf409be20 msgr2=0x7fbcf41d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 1 --2- 10.20.193.77:0/4285852188 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbcf409be20 0x7fbcf41d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 1 -- 10.20.193.77:0/4285852188 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbcf40a5070 msgr2=0x7fbcf41d2eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:15.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 1 --2- 10.20.193.77:0/4285852188 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbcf40a5070 0x7fbcf41d2eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 1 monclient: found mon.noname-c 2026-02-17T12:05:15.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7fbcf37fe640 1 -- 10.20.193.77:0/4285852188 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf40aaf30 con 0x7fbcf40a4c20 2026-02-17T12:05:15.146 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f797a1f7640 10 monclient: get_monmap_and_config 2026-02-17T12:05:15.146 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f797a1f7640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.146 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f797a1f7640 10 monclient: monmap: 2026-02-17T12:05:15.146 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.146 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:15.108621+0000 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:15.108621+0000 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.103+0000 7f797a1f7640 1 Processor -- start 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 1 -- start start 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 10 monclient: init 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 10 monclient: _add_conns ranks=[2,4,1,3,0] 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f7974131d70 0x7f797409e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 10 monclient(hunting): picked mon.noname-b con 0x7f7974131d70 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f7974132150 0x7f7974134db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 10 monclient(hunting): picked mon.noname-c con 0x7f7974132150 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:15.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7974132550 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:15.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79740a3800 con 0x7f7974132550 2026-02-17T12:05:15.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f79740a3a00 con 0x7f7974132150 2026-02-17T12:05:15.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f79741318b0 con 0x7f7974131d70 2026-02-17T12:05:15.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b76ffd640 1 -- 10.20.193.77:0/3922067887 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b780a2a10 msgr2=0x7f4b7809cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b76ffd640 1 --2- 10.20.193.77:0/3922067887 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b780a2a10 0x7f4b7809cb50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4b78074df0 tx=0x7f4b6801c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99ab6bdf23c2f647 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f797a1f7640 10 monclient(hunting): authenticate will time out at 566.784341s 2026-02-17T12:05:15.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f7974131d70 0x7f797409e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f7974131d70 0x7f797409e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50676/0 (socket says 10.20.193.77:50676) 2026-02-17T12:05:15.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 1 -- 10.20.193.77:0/3003928296 learned_addr learned my addr 10.20.193.77:0/3003928296 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 10 monclient(hunting): get_auth_request con 0x7f7974131d70 auth_method 0 2026-02-17T12:05:15.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b767fc640 1 -- 10.20.193.77:0/3922067887 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b680b1070 con 0x7f4b780a2a10 2026-02-17T12:05:15.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b767fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:15.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b767fc640 10 monclient: dump: 2026-02-17T12:05:15.150 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.150 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.150 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.150 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.150 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.150 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.150 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.150 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.150 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.150 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b767fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b767fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 5 monclient: authenticate success, global_id 4219 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b767fc640 1 -- 10.20.193.77:0/3922067887 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b68004230 con 0x7f4b780a2a10 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b767fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 4 set_mon_vals no callback set 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b767fc640 1 -- 10.20.193.77:0/3922067887 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b680a8050 con 0x7f4b780a2a10 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b767fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b767fc640 10 monclient: dump: 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.151 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.152 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.152 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.152 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.152 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.152 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.152 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.152 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 10 monclient(hunting): handle_auth_done global_id 4229 payload 274 2026-02-17T12:05:15.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 1 -- 10.20.193.77:0/3003928296 >> v2:10.20.193.119:3300/0 conn(0x7f7974132150 msgr2=0x7f7974134db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 1 --2- 10.20.193.77:0/3003928296 >> v2:10.20.193.119:3300/0 conn(0x7f7974132150 0x7f7974134db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 1 -- 10.20.193.77:0/3003928296 >> v1:10.20.193.119:6789/0 conn(0x7f7974132550 legacy=0x7f79741352f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 1 monclient: found mon.noname-b 2026-02-17T12:05:15.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f79737fe640 1 -- 10.20.193.77:0/3003928296 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797409d170 con 0x7f7974131d70 2026-02-17T12:05:15.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient: shutdown 2026-02-17T12:05:15.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/3922067887 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b780a2a10 msgr2=0x7f4b7809cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 --2- 10.20.193.77:0/3922067887 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b780a2a10 0x7f4b7809cb50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4b78074df0 tx=0x7f4b6801c500 comp rx=0 tx=0).stop 2026-02-17T12:05:15.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/3922067887 shutdown_connections 2026-02-17T12:05:15.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 --2- 10.20.193.77:0/3922067887 >> v2:10.20.193.77:3300/0 conn(0x7f4b7813d6d0 0x7f4b7813fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 --2- 10.20.193.77:0/3922067887 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b780a2a10 0x7f4b7809cb50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/3922067887 >> 10.20.193.77:0/3922067887 conn(0x7f4b780a76f0 msgr2=0x7f4b780a7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb842ffd640 1 -- 10.20.193.77:0/653612929 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8300b1070 con 0x7fb8440a3220 2026-02-17T12:05:15.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb842ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/3922067887 shutdown_connections 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb842ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb842ffd640 10 monclient: dump: 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb842ffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb842ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb842ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.154 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb842ffd640 1 -- 10.20.193.77:0/653612929 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8300ac640 con 0x7fb8440a3220 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb842ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb842ffd640 1 -- 10.20.193.77:0/653612929 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8300aca10 con 0x7fb8440a3220 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 5 monclient: authenticate success, global_id 4216 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/3922067887 wait complete. 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 4 set_mon_vals no callback set 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb842ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb842ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb842ffd640 10 monclient: dump: 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.155 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient: shutdown 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 -- 10.20.193.77:0/653612929 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8440a3220 msgr2=0x7fb84406c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 --2- 10.20.193.77:0/653612929 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8440a3220 0x7fb84406c8e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb8300098c0 tx=0x7fb83001c480 comp rx=0 tx=0).stop 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 -- 10.20.193.77:0/653612929 shutdown_connections 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 --2- 10.20.193.77:0/653612929 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8440a3220 0x7fb84406c8e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 -- 10.20.193.77:0/653612929 >> 10.20.193.77:0/653612929 conn(0x7fb8440a4310 msgr2=0x7fb8440a46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf37fe640 1 -- 10.20.193.77:0/4285852188 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbcf40a4c20 msgr2=0x7fbcf41d2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf37fe640 1 --2- 10.20.193.77:0/4285852188 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbcf40a4c20 0x7fbcf41d2970 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbce400c550 tx=0x7fbce400ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient: monmap: 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.156 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:15.157 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:15.157 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:15.157 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.157 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.157 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:15.157 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:15.157 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:15.157 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 -- 10.20.193.77:0/653612929 shutdown_connections 2026-02-17T12:05:15.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 -- 10.20.193.77:0/653612929 wait complete. 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 1 -- 10.20.193.77:0/4285852188 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4016030 con 0x7fbcf40a4c20 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 10 monclient: dump: 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 1 -- 10.20.193.77:0/4285852188 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce4005020 con 0x7fbcf40a4c20 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 1 -- 10.20.193.77:0/4285852188 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4005410 con 0x7fbcf40a4c20 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 10 monclient: dump: 2026-02-17T12:05:15.158 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf27fc640 4 set_mon_vals no callback set 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcfaa0c640 5 monclient: authenticate success, global_id 4226 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcfaa0c640 10 monclient: _renew_subs 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcfaa0c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/4285852188 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf406f590 con 0x7fbcf40a4c20 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcfaa0c640 10 monclient: _renew_subs 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcfaa0c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/4285852188 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf40a3bc0 con 0x7fbcf40a4c20 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 Processor -- start 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 -- start start 2026-02-17T12:05:15.159 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient: init 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 10 monclient: get_monmap_and_config 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 10 monclient: monmap: 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:15.110960+0000 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:15.110960+0000 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient: monmap: 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:15.160 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b780a1f20 0x7f4b78099f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient(hunting): picked mon.noname-b con 0x7f4b780a1f20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4b780a2a10 0x7f4b780918c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient(hunting): picked mon.noname-a con 0x7f4b780a2a10 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4b7813d6d0 0x7f4b78091e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient(hunting): picked mon.noname-c con 0x7f4b7813d6d0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4b78142be0 con 0x7f4b780a2a10 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.161 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b78142a60 con 0x7f4b780a1f20 2026-02-17T12:05:15.162 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.162 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4b78142d60 con 0x7f4b7813d6d0 2026-02-17T12:05:15.162 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.162 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b7cb4e640 10 monclient(hunting): authenticate will time out at 566.785903s 2026-02-17T12:05:15.162 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcfaa0c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.162 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/4285852188 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbcf4134e20 con 0x7fbcf40a4c20 2026-02-17T12:05:15.162 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b76ffd640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4b780a2a10 0x7f4b780918c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.162 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4b7813d6d0 0x7f4b78091e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.162 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b76ffd640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4b780a2a10 0x7f4b780918c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44376/0 (socket says 10.20.193.77:44376) 2026-02-17T12:05:15.162 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b76ffd640 1 -- 10.20.193.77:0/2396097038 learned_addr learned my addr 10.20.193.77:0/2396097038 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.162 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 10 monclient(hunting): get_auth_request con 0x7f4b7813d6d0 auth_method 0 2026-02-17T12:05:15.162 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.162 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.162 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.163 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b76ffd640 10 monclient(hunting): get_auth_request con 0x7f4b780a2a10 auth_method 0 2026-02-17T12:05:15.163 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b76ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.163 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b76ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.163 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b76ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.163 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.163 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.163 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 1 Processor -- start 2026-02-17T12:05:15.163 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.163 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b76ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.163 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b76ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.163 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b76ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.163 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 Processor -- start 2026-02-17T12:05:15.163 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b777fe640 1 --2- 10.20.193.77:0/2396097038 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b780a1f20 0x7f4b78099f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.163 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b777fe640 10 monclient(hunting): get_auth_request con 0x7f4b780a1f20 auth_method 0 2026-02-17T12:05:15.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 1 -- start start 2026-02-17T12:05:15.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 10 monclient: init 2026-02-17T12:05:15.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 -- start start 2026-02-17T12:05:15.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient: init 2026-02-17T12:05:15.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 1 -- 10.20.193.77:0/4285852188 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fbce4023060 con 0x7fbcf40a4c20 2026-02-17T12:05:15.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 10 monclient(hunting): handle_auth_done global_id 4232 payload 824 2026-02-17T12:05:15.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 1 -- 10.20.193.77:0/2396097038 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b780a1f20 msgr2=0x7f4b78099f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 1 --2- 10.20.193.77:0/2396097038 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f4b780a1f20 0x7f4b78099f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 1 -- 10.20.193.77:0/2396097038 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4b780a2a10 msgr2=0x7f4b780918c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 1 --2- 10.20.193.77:0/2396097038 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4b780a2a10 0x7f4b780918c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 1 monclient: found mon.noname-c 2026-02-17T12:05:15.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b77fff640 1 -- 10.20.193.77:0/2396097038 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b78093e10 con 0x7f4b7813d6d0 2026-02-17T12:05:15.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f4b76ffd640 1 --2- 10.20.193.77:0/2396097038 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f4b780a2a10 0x7f4b780918c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:15.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 1 --2- 10.20.193.77:0/4285852188 >> v2:10.20.193.119:6800/4127986552 conn(0x7fbcc403a120 0x7fbcc403c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 1 -- 10.20.193.77:0/4285852188 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7fbce404d530 con 0x7fbcf40a4c20 2026-02-17T12:05:15.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 10 monclient: _add_conns ranks=[4,0,3,2,1] 2026-02-17T12:05:15.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f9fdc0a89c0 0x7f9fdc138380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4affd640 1 -- 10.20.193.77:0/2183496461 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb4c0a3670 msgr2=0x7ffb4c0a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4affd640 1 --2- 10.20.193.77:0/2183496461 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb4c0a3670 0x7ffb4c0a3a80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0098c0 tx=0x7ffb3c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ec10de98deedff8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 10 monclient(hunting): picked mon.noname-c con 0x7f9fdc0a89c0 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9fdc1388c0 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f9fdc138cf0 0x7f9fdc0a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 10 monclient(hunting): picked mon.noname-a con 0x7f9fdc138cf0 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fdc0aa3f0 con 0x7f9fdc1388c0 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9fdc0a4680 con 0x7f9fdc138cf0 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9fdc0aa630 con 0x7f9fdc0a89c0 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fe0fc5640 10 monclient(hunting): authenticate will time out at 566.786414s 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb8440a0200 0x7fb8441d2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient(hunting): picked mon.noname-c con 0x7fb8440a0200 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8440a3220 0x7fb844099e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient(hunting): picked mon.noname-b con 0x7fb8440a3220 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:15.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fb84409a370 0x7fb84413e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 1 --2- 10.20.193.77:0/4285852188 >> v2:10.20.193.77:6801/662135547 conn(0x7fbcc403fbc0 0x7fbcc4042000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 1 -- 10.20.193.77:0/4285852188 --> v2:10.20.193.77:6801/662135547 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcc4042690 con 0x7fbcc403fbc0 2026-02-17T12:05:15.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient(hunting): picked mon.noname-a con 0x7fb84409a370 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:15.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb844075130 con 0x7fb84409a370 2026-02-17T12:05:15.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb84406d740 con 0x7fb8440a3220 2026-02-17T12:05:15.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 1 -- 10.20.193.77:0/4285852188 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbce4054050 con 0x7fbcf40a4c20 2026-02-17T12:05:15.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf0ff9640 10 monclient: handle_get_version_reply finishing 1 version 20 2026-02-17T12:05:15.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb844143b20 con 0x7fb8440a0200 2026-02-17T12:05:15.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb84a4c8640 10 monclient(hunting): authenticate will time out at 566.786468s 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f9fdc138cf0 0x7f9fdc0a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fd9d74640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f9fdc1388c0 0x7f9fdc0a8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42374/0 (socket says 10.20.193.77:42374) 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fd9d74640 1 -- 10.20.193.77:0/1447959990 learned_addr learned my addr 10.20.193.77:0/1447959990 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 10 monclient(hunting): get_auth_request con 0x7f9fdc138cf0 auth_method 0 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb8440a0200 0x7fb8441d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb8440a0200 0x7fb8441d2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50688/0 (socket says 10.20.193.77:50688) 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 1 -- 10.20.193.77:0/2560947117 learned_addr learned my addr 10.20.193.77:0/2560947117 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 10 monclient(hunting): get_auth_request con 0x7fb8440a0200 auth_method 0 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf3fff640 1 --2- 10.20.193.77:0/4285852188 >> v2:10.20.193.119:6800/4127986552 conn(0x7fbcc403a120 0x7fbcc403c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf3fff640 10 monclient: get_auth_request con 0x7fbcc403a120 auth_method 0 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf8f82640 1 --2- 10.20.193.77:0/4285852188 >> v2:10.20.193.77:6801/662135547 conn(0x7fbcc403fbc0 0x7fbcc4042000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fda575640 1 --2- 10.20.193.77:0/1447959990 >> v2:10.20.193.119:3300/0 conn(0x7f9fdc0a89c0 0x7f9fdc138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb848a3e640 1 --2- 10.20.193.77:0/2560947117 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fb84409a370 0x7fb84413e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb848a3e640 10 monclient(hunting): get_auth_request con 0x7fb84409a370 auth_method 0 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb848a3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4a7fc640 1 -- 10.20.193.77:0/2183496461 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c0aa6f0 con 0x7ffb4c0a3670 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4a7fc640 10 monclient: dump: 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4a7fc640 1 -- 10.20.193.77:0/2183496461 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb3c0af070 con 0x7ffb4c0a3670 2026-02-17T12:05:15.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fbcf8f82640 10 monclient: get_auth_request con 0x7fbcc403fbc0 auth_method 0 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fda575640 10 monclient(hunting): get_auth_request con 0x7f9fdc0a89c0 auth_method 0 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fda575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fda575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fda575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb848a3e640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb848a3e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4a7fc640 1 -- 10.20.193.77:0/2183496461 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c0aaab0 con 0x7ffb4c0a3670 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb51ecf640 5 monclient: authenticate success, global_id 4222 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb51ecf640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb51ecf640 4 set_mon_vals no callback set 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb4a7fc640 10 monclient: dump: 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.170 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb8437fe640 1 --2- 10.20.193.77:0/2560947117 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8440a3220 0x7fb844099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb848a3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb848a3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb848a3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb8437fe640 10 monclient(hunting): get_auth_request con 0x7fb8440a3220 auth_method 0 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb8437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb8437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb8437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 10 monclient(hunting): handle_auth_done global_id 4248 payload 274 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 1 -- 10.20.193.77:0/1447959990 >> v2:10.20.193.119:3300/0 conn(0x7f9fdc0a89c0 msgr2=0x7f9fdc138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 1 --2- 10.20.193.77:0/1447959990 >> v2:10.20.193.119:3300/0 conn(0x7f9fdc0a89c0 0x7f9fdc138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 1 -- 10.20.193.77:0/1447959990 >> v1:10.20.193.77:6789/0 conn(0x7f9fdc1388c0 legacy=0x7f9fdc0a8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 1 monclient: found mon.noname-a 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7f9fdad76640 1 -- 10.20.193.77:0/1447959990 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc09ce80 con 0x7f9fdc138cf0 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 10 monclient(hunting): handle_auth_done global_id 4235 payload 824 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 1 -- 10.20.193.77:0/2560947117 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8440a3220 msgr2=0x7fb844099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 1 --2- 10.20.193.77:0/2560947117 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb8440a3220 0x7fb844099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 1 -- 10.20.193.77:0/2560947117 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fb84409a370 msgr2=0x7fb84413e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 1 --2- 10.20.193.77:0/2560947117 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fb84409a370 0x7fb84413e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 1 monclient: found mon.noname-c 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7fb843fff640 1 -- 10.20.193.77:0/2560947117 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb844140170 con 0x7fb8440a0200 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb51ecf640 10 monclient: shutdown 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb51ecf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2183496461 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb4c0a3670 msgr2=0x7ffb4c0a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb51ecf640 1 --2- 10.20.193.77:0/2183496461 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb4c0a3670 0x7ffb4c0a3a80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0098c0 tx=0x7ffb3c01c510 comp rx=0 tx=0).stop 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2183496461 shutdown_connections 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb51ecf640 1 --2- 10.20.193.77:0/2183496461 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb4c0a3670 0x7ffb4c0a3a80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2183496461 >> 10.20.193.77:0/2183496461 conn(0x7ffb4c0a8a60 msgr2=0x7ffb4c0a8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2183496461 shutdown_connections 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2183496461 wait complete. 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb51ecf640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.107+0000 7ffb51ecf640 10 monclient: monmap: 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 1 Processor -- start 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 1 -- start start 2026-02-17T12:05:15.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient: init 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79737fe640 1 -- 10.20.193.77:0/3003928296 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f7974131d70 msgr2=0x7f797409e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79737fe640 1 --2- 10.20.193.77:0/3003928296 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f7974131d70 0x7f797409e240 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7960009970 tx=0x7f796001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f28f9b0399e429b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79727fc640 1 -- 10.20.193.77:0/3003928296 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79600b0070 con 0x7f7974131d70 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79727fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79727fc640 10 monclient: dump: 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79727fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79727fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79727fc640 1 -- 10.20.193.77:0/3003928296 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7960004230 con 0x7f7974131d70 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79727fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79727fc640 1 -- 10.20.193.77:0/3003928296 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960003720 con 0x7f7974131d70 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 5 monclient: authenticate success, global_id 4229 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 4 set_mon_vals no callback set 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f79727fc640 10 monclient: dump: 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.174 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b77fff640 1 -- 10.20.193.77:0/2396097038 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4b7813d6d0 msgr2=0x7f4b78091e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b77fff640 1 --2- 10.20.193.77:0/2396097038 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4b7813d6d0 0x7f4b78091e00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00be20 tx=0x7f4b6c00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb4c0a3290 0x7ffb4c1d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient(hunting): picked mon.noname-b con 0x7ffb4c0a3290 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ffb4c0a3670 0x7ffb4c1364f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient(hunting): picked mon.noname-c con 0x7ffb4c0a3670 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7ffb4c13b510 0x7ffb4c09ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient(hunting): picked mon.noname-a con 0x7ffb4c13b510 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4c141c00 con 0x7ffb4c13b510 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4c141a80 con 0x7ffb4c0a3290 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffb4c141d80 con 0x7ffb4c0a3670 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient(hunting): authenticate will time out at 566.788366s 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 1 -- 10.20.193.77:0/2396097038 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c00cc60 con 0x7f4b7813d6d0 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 10 monclient: dump: 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 1 -- 10.20.193.77:0/2396097038 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b6c010070 con 0x7f4b7813d6d0 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 1 -- 10.20.193.77:0/2396097038 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0042b0 con 0x7f4b7813d6d0 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 10 monclient: dump: 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.176 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b75ffb640 4 set_mon_vals no callback set 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b7cb4e640 5 monclient: authenticate success, global_id 4232 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b7cb4e640 10 monclient: _renew_subs 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b7cb4e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/2396097038 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b78095610 con 0x7f4b7813d6d0 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b7cb4e640 10 monclient: _renew_subs 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b7cb4e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/2396097038 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b78095050 con 0x7f4b7813d6d0 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient: shutdown 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 -- 10.20.193.77:0/3003928296 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f7974131d70 msgr2=0x7f797409e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 --2- 10.20.193.77:0/3003928296 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f7974131d70 0x7f797409e240 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7960009970 tx=0x7f796001c360 comp rx=0 tx=0).stop 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb4c0a3290 0x7ffb4c1d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb4c0a3290 0x7ffb4c1d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.119:3300/0 says I am v2:10.20.193.77:40536/0 (socket says 10.20.193.77:40536) 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 1 -- 10.20.193.77:0/2892972488 learned_addr learned my addr 10.20.193.77:0/2892972488 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 10 monclient(hunting): get_auth_request con 0x7ffb4c0a3290 auth_method 0 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 -- 10.20.193.77:0/3003928296 shutdown_connections 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 --2- 10.20.193.77:0/3003928296 >> v2:10.20.193.119:3300/0 conn(0x7f7974132150 0x7f7974134db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 --2- 10.20.193.77:0/3003928296 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f7974131d70 0x7f797409e240 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 -- 10.20.193.77:0/3003928296 >> 10.20.193.77:0/3003928296 conn(0x7f79740a4230 msgr2=0x7f79740a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 -- 10.20.193.77:0/3003928296 shutdown_connections 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 -- 10.20.193.77:0/3003928296 wait complete. 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4bfff640 1 --2- 10.20.193.77:0/2892972488 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7ffb4c13b510 0x7ffb4c09ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4bfff640 10 monclient(hunting): get_auth_request con 0x7ffb4c13b510 auth_method 0 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b7cb4e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/2396097038 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b7809cb50 con 0x7f4b7813d6d0 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 10 monclient(hunting): handle_auth_done global_id 4234 payload 824 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 1 -- 10.20.193.77:0/2892972488 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ffb4c0a3670 msgr2=0x7ffb4c1364f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 1 --2- 10.20.193.77:0/2892972488 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ffb4c0a3670 0x7ffb4c1364f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 1 -- 10.20.193.77:0/2892972488 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7ffb4c13b510 msgr2=0x7ffb4c09ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 1 --2- 10.20.193.77:0/2892972488 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7ffb4c13b510 0x7ffb4c09ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 1 -- 10.20.193.77:0/2396097038 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f4b6c004490 con 0x7f4b7813d6d0 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 1 monclient: found mon.noname-b 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.119:3300/0 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 1 -- 10.20.193.77:0/2892972488 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4c11fb90 con 0x7ffb4c0a3290 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb843fff640 1 -- 10.20.193.77:0/2560947117 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb8440a0200 msgr2=0x7fb8441d2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb843fff640 1 --2- 10.20.193.77:0/2560947117 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb8440a0200 0x7fb8441d2170 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb83001c2b0 tx=0x7fb830019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 1 -- 10.20.193.77:0/2560947117 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8300ba020 con 0x7fb8440a0200 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 10 monclient: dump: 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.179 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 1 -- 10.20.193.77:0/2560947117 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8300b6aa0 con 0x7fb8440a0200 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 1 --2- 10.20.193.77:0/2396097038 >> v2:10.20.193.119:6800/4127986552 conn(0x7f4b4403a1a0 0x7f4b4403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb84a4c8640 5 monclient: authenticate success, global_id 4235 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb84a4c8640 10 monclient: _renew_subs 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb84a4c8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb84a4c8640 1 -- 10.20.193.77:0/2560947117 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8440925c0 con 0x7fb8440a0200 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 1 -- 10.20.193.77:0/2560947117 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8300b1040 con 0x7fb8440a0200 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 10 monclient: dump: 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.180 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 1 -- 10.20.193.77:0/2396097038 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f4b6c04dcd0 con 0x7f4b7813d6d0 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb8427fc640 4 set_mon_vals no callback set 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb84a4c8640 10 monclient: _renew_subs 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb84a4c8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb84a4c8640 1 -- 10.20.193.77:0/2560947117 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8440a6d30 con 0x7fb8440a0200 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fbcf3fff640 1 --2- 10.20.193.77:0/4285852188 >> v2:10.20.193.119:6800/4127986552 conn(0x7fbcc403a120 0x7fbcc403c5e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40a7cb0 tx=0x7fbce0004840 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient: monmap: 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:15.181 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 1 --2- 10.20.193.77:0/2396097038 >> v2:10.20.193.119:6801/3041501560 conn(0x7f4b4403fd30 0x7f4b44042170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 1 -- 10.20.193.77:0/2396097038 --> v2:10.20.193.119:6801/3041501560 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b6c018e50 con 0x7f4b4403fd30 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 1 -- 10.20.193.77:0/2396097038 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4b6c054020 con 0x7f4b7813d6d0 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b63fff640 10 monclient: handle_get_version_reply finishing 1 version 20 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b777fe640 1 --2- 10.20.193.77:0/2396097038 >> v2:10.20.193.119:6800/4127986552 conn(0x7f4b4403a1a0 0x7f4b4403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b777fe640 10 monclient: get_auth_request con 0x7f4b4403a1a0 auth_method 0 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb84a4c8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb84a4c8640 1 -- 10.20.193.77:0/2560947117 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb84409ea00 con 0x7fb8440a0200 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 Processor -- start 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b76ffd640 1 --2- 10.20.193.77:0/2396097038 >> v2:10.20.193.119:6801/3041501560 conn(0x7f4b4403fd30 0x7f4b44042170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b76ffd640 10 monclient: get_auth_request con 0x7f4b4403fd30 auth_method 0 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 -- start start 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient: init 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 1 -- 10.20.193.77:0/2560947117 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fb8300b53e0 con 0x7fb8440a0200 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 1 --2- 10.20.193.77:0/2560947117 >> v2:10.20.193.119:6800/4127986552 conn(0x7fb81403a170 0x7fb81403c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 1 -- 10.20.193.77:0/2560947117 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7fb8300e7f10 con 0x7fb8440a0200 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 1 --2- 10.20.193.77:0/2560947117 >> v2:10.20.193.119:6809/3174335982 conn(0x7fb81403fc90 0x7fb8140420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 1 -- 10.20.193.77:0/2560947117 --> v2:10.20.193.119:6809/3174335982 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb814042760 con 0x7fb81403fc90 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 1 -- 10.20.193.77:0/2560947117 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb8300ea4e0 con 0x7fb8440a0200 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7974131d70 0x7f797413f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient(hunting): picked mon.noname-b con 0x7f7974131d70 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb840ff9640 10 monclient: handle_get_version_reply finishing 1 version 20 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f7974132150 0x7f797413fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient(hunting): picked mon.noname-a con 0x7f7974132150 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f7974132550 0x7f7974140390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient(hunting): picked mon.noname-c con 0x7f7974132550 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f797406ca60 con 0x7f7974132150 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f797406c8e0 con 0x7f7974131d70 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.183 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f797406cbe0 con 0x7f7974132550 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f797a1f7640 10 monclient(hunting): authenticate will time out at 566.789920s 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7972ffd640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f7974132150 0x7f797413fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f7974132550 0x7f7974140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7972ffd640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f7974132150 0x7f797413fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44420/0 (socket says 10.20.193.77:44420) 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7972ffd640 1 -- 10.20.193.77:0/3249348891 learned_addr learned my addr 10.20.193.77:0/3249348891 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7972ffd640 10 monclient(hunting): get_auth_request con 0x7f7974132150 auth_method 0 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7972ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7972ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7972ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb848a3e640 1 --2- 10.20.193.77:0/2560947117 >> v2:10.20.193.119:6809/3174335982 conn(0x7fb81403fc90 0x7fb8140420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 10 monclient(hunting): get_auth_request con 0x7f7974132550 auth_method 0 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb848a3e640 10 monclient: get_auth_request con 0x7fb81403fc90 auth_method 0 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.184 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7972ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7972ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7972ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 10 monclient(hunting): handle_auth_done global_id 4238 payload 824 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 1 -- 10.20.193.77:0/3249348891 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7974131d70 msgr2=0x7f797413f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 1 --2- 10.20.193.77:0/3249348891 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f7974131d70 0x7f797413f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 1 -- 10.20.193.77:0/3249348891 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f7974132150 msgr2=0x7f797413fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 1 --2- 10.20.193.77:0/3249348891 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f7974132150 0x7f797413fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 1 monclient: found mon.noname-c 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f7973fff640 1 -- 10.20.193.77:0/3249348891 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79740971e0 con 0x7f7974132550 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fdad76640 1 -- 10.20.193.77:0/1447959990 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fdc138cf0 msgr2=0x7f9fdc0a94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fdad76640 1 --2- 10.20.193.77:0/1447959990 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fdc138cf0 0x7f9fdc0a94b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0ab7d0 tx=0x7f9fcc01c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2a26d7f41220d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fd9573640 1 -- 10.20.193.77:0/1447959990 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0b2070 con 0x7f9fdc138cf0 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fd9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fd9573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fd9573640 10 monclient: dump: 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.185 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fd9573640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fd9573640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fd9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fd9573640 1 -- 10.20.193.77:0/1447959990 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fcc0a57a0 con 0x7f9fdc138cf0 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fd9573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 5 monclient: authenticate success, global_id 4248 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fd9573640 1 -- 10.20.193.77:0/1447959990 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0a5b70 con 0x7f9fdc138cf0 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fd9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 4 set_mon_vals no callback set 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fd9573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fd9573640 10 monclient: dump: 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 10 monclient: shutdown 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/1447959990 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fdc138cf0 msgr2=0x7f9fdc0a94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 1 --2- 10.20.193.77:0/1447959990 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fdc138cf0 0x7f9fdc0a94b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0ab7d0 tx=0x7f9fcc01c810 comp rx=0 tx=0).stop 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fbcf8f82640 1 --2- 10.20.193.77:0/4285852188 >> v2:10.20.193.77:6801/662135547 conn(0x7fbcc403fbc0 0x7fbcc4042000 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/1447959990 shutdown_connections 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 1 --2- 10.20.193.77:0/1447959990 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fdc138cf0 0x7f9fdc0a94b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 1 --2- 10.20.193.77:0/1447959990 >> v2:10.20.193.119:3300/0 conn(0x7f9fdc0a89c0 0x7f9fdc138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/1447959990 >> 10.20.193.77:0/1447959990 conn(0x7f9fdc074c20 msgr2=0x7f9fdc0aabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.186 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/1447959990 shutdown_connections 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/1447959990 wait complete. 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 1 -- 10.20.193.77:0/2892972488 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb4c0a3290 msgr2=0x7ffb4c1d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb4b7fe640 1 --2- 10.20.193.77:0/2892972488 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb4c0a3290 0x7ffb4c1d0010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800c580 tx=0x7ffb3800ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb27fff640 1 -- 10.20.193.77:0/2892972488 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb38016020 con 0x7ffb4c0a3290 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb27fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb27fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb27fff640 10 monclient: dump: 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb27fff640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb27fff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb27fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 5 monclient: authenticate success, global_id 4234 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient: _renew_subs 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2892972488 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb4c11fe70 con 0x7ffb4c0a3290 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fbcf0ff9640 1 -- 10.20.193.77:0/4285852188 <== osd.1 v2:10.20.193.77:6801/662135547 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fbcc4042690 con 0x7fbcc403fbc0 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient: _renew_subs 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:05:15.187 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2892972488 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb4c13ecf0 con 0x7ffb4c0a3290 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 10 monclient: monmap: 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb27fff640 1 -- 10.20.193.77:0/2892972488 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb38012a60 con 0x7ffb4c0a3290 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb27fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb27fff640 1 -- 10.20.193.77:0/2892972488 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb38012e50 con 0x7ffb4c0a3290 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb27fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb27fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb27fff640 10 monclient: dump: 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.188 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb49ffb640 4 set_mon_vals no callback set 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 1 Processor -- start 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 1 -- start start 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 10 monclient: init 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.119:3300/0 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2892972488 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb4c09fa80 con 0x7ffb4c0a3290 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f4b777fe640 1 --2- 10.20.193.77:0/2396097038 >> v2:10.20.193.119:6800/4127986552 conn(0x7f4b4403a1a0 0x7f4b4403c660 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009990 tx=0x7f4b64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb8437fe640 1 --2- 10.20.193.77:0/2560947117 >> v2:10.20.193.119:6800/4127986552 conn(0x7fb81403a170 0x7fb81403c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7fb8437fe640 10 monclient: get_auth_request con 0x7fb81403a170 auth_method 0 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.111+0000 7f9fe0fc5640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9fdc0a89c0 0x7f9fdc1d2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 10 monclient(hunting): picked mon.noname-c con 0x7f9fdc0a89c0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fdc1388c0 0x7f9fdc137570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 10 monclient(hunting): picked mon.noname-a con 0x7f9fdc1388c0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9fdc138cf0 0x7f9fdc13d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.189 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 10 monclient(hunting): picked mon.noname-b con 0x7f9fdc138cf0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc142f80 con 0x7f9fdc1388c0 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc142e00 con 0x7f9fdc138cf0 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9fdc143100 con 0x7f9fdc0a89c0 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 10 monclient(hunting): authenticate will time out at 566.792043s 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fdc1388c0 0x7f9fdc137570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fdc1388c0 0x7f9fdc137570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44432/0 (socket says 10.20.193.77:44432) 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 1 -- 10.20.193.77:0/2605786452 learned_addr learned my addr 10.20.193.77:0/2605786452 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 10 monclient(hunting): get_auth_request con 0x7f9fdc1388c0 auth_method 0 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7ffb27fff640 1 -- 10.20.193.77:0/2892972488 <== mon.1 v2:10.20.193.119:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7ffb3801b400 con 0x7ffb4c0a3290 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fdad76640 1 --2- 10.20.193.77:0/2605786452 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9fdc138cf0 0x7f9fdc13d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 10 monclient(hunting): handle_auth_done global_id 4260 payload 824 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 1 -- 10.20.193.77:0/2605786452 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9fdc0a89c0 msgr2=0x7f9fdc1d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 1 --2- 10.20.193.77:0/2605786452 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9fdc0a89c0 0x7f9fdc1d2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 1 -- 10.20.193.77:0/2605786452 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9fdc138cf0 msgr2=0x7f9fdc13d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 1 --2- 10.20.193.77:0/2605786452 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9fdc138cf0 0x7f9fdc13d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 1 monclient: found mon.noname-a 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 1 -- 10.20.193.77:0/2605786452 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc121f00 con 0x7f9fdc1388c0 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fdad76640 10 monclient: get_auth_request con 0x7f9fdc138cf0 auth_method 0 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fdad76640 1 --2- 10.20.193.77:0/2605786452 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9fdc138cf0 0x7f9fdc13d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7ffb27fff640 1 --2- 10.20.193.77:0/2892972488 >> v2:10.20.193.119:6800/4127986552 conn(0x7ffb1c03a2c0 0x7ffb1c03c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7ffb27fff640 1 -- 10.20.193.77:0/2892972488 <== mon.1 v2:10.20.193.119:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7ffb3804e280 con 0x7ffb4c0a3290 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f7973fff640 1 -- 10.20.193.77:0/3249348891 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f7974132550 msgr2=0x7f7974140390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f7973fff640 1 --2- 10.20.193.77:0/3249348891 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f7974132550 0x7f7974140390 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f796800be20 tx=0x7f796800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7ffb27fff640 1 --2- 10.20.193.77:0/2892972488 >> v2:10.20.193.77:6800/1107649769 conn(0x7ffb1c03fdd0 0x7ffb1c042210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7ffb27fff640 1 -- 10.20.193.77:0/2892972488 --> v2:10.20.193.77:6800/1107649769 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb38012e50 con 0x7ffb1c03fdd0 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7ffb27fff640 1 -- 10.20.193.77:0/2892972488 <== mon.1 v2:10.20.193.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ffb3804e560 con 0x7ffb4c0a3290 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7ffb27fff640 10 monclient: handle_get_version_reply finishing 1 version 20 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7ffb4affd640 1 --2- 10.20.193.77:0/2892972488 >> v2:10.20.193.119:6800/4127986552 conn(0x7ffb1c03a2c0 0x7ffb1c03c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 1 -- 10.20.193.77:0/3249348891 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796800cb60 con 0x7f7974132550 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:15.191 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7ffb4affd640 10 monclient: get_auth_request con 0x7ffb1c03a2c0 auth_method 0 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 10 monclient: dump: 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 1 -- 10.20.193.77:0/3249348891 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7968010070 con 0x7f7974132550 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7ffb4bfff640 1 --2- 10.20.193.77:0/2892972488 >> v2:10.20.193.77:6800/1107649769 conn(0x7ffb1c03fdd0 0x7ffb1c042210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7ffb4bfff640 10 monclient: get_auth_request con 0x7ffb1c03fdd0 auth_method 0 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 1 -- 10.20.193.77:0/3249348891 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7968004070 con 0x7f7974132550 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f797a1f7640 5 monclient: authenticate success, global_id 4238 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f797a1f7640 10 monclient: _renew_subs 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f7971ffb640 4 set_mon_vals no callback set 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f797a1f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f797a1f7640 1 -- 10.20.193.77:0/3249348891 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797409b220 con 0x7f7974132550 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 10 monclient: dump: 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f797a1f7640 10 monclient: _renew_subs 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f797a1f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f797a1f7640 1 -- 10.20.193.77:0/3249348891 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f79740965d0 con 0x7f7974132550 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f797a1f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f797a1f7640 1 -- 10.20.193.77:0/3249348891 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f797409e240 con 0x7f7974132550 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 1 -- 10.20.193.77:0/3249348891 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f796801d030 con 0x7f7974132550 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 1 --2- 10.20.193.77:0/3249348891 >> v2:10.20.193.119:6800/4127986552 conn(0x7f794403a170 0x7f794403c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 1 -- 10.20.193.77:0/3249348891 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f796804d650 con 0x7f7974132550 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 1 --2- 10.20.193.77:0/3249348891 >> v2:10.20.193.77:6808/3812083705 conn(0x7f794403fc90 0x7f79440420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 1 -- 10.20.193.77:0/3249348891 --> v2:10.20.193.77:6808/3812083705 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7944042760 con 0x7f794403fc90 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 1 -- 10.20.193.77:0/3249348891 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7968054050 con 0x7f7974132550 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f794ffff640 10 monclient: handle_get_version_reply finishing 1 version 20 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f7972ffd640 1 --2- 10.20.193.77:0/3249348891 >> v2:10.20.193.77:6808/3812083705 conn(0x7f794403fc90 0x7f79440420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f7972ffd640 10 monclient: get_auth_request con 0x7f794403fc90 auth_method 0 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f4b76ffd640 1 --2- 10.20.193.77:0/2396097038 >> v2:10.20.193.119:6801/3041501560 conn(0x7f4b4403fd30 0x7f4b44042170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7fb8437fe640 1 --2- 10.20.193.77:0/2560947117 >> v2:10.20.193.119:6800/4127986552 conn(0x7fb81403a170 0x7fb81403c630 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb844092ab0 tx=0x7fb834009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 1 -- 10.20.193.77:0/2605786452 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fdc1388c0 msgr2=0x7f9fdc137570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd9d74640 1 --2- 10.20.193.77:0/2605786452 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fdc1388c0 0x7f9fdc137570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400c570 tx=0x7f9fc400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 1 -- 10.20.193.77:0/2605786452 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4007070 con 0x7f9fdc1388c0 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 10 monclient: dump: 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7fb848a3e640 1 --2- 10.20.193.77:0/2560947117 >> v2:10.20.193.119:6809/3174335982 conn(0x7fb81403fc90 0x7fb8140420d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 1 -- 10.20.193.77:0/2605786452 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc4007210 con 0x7f9fdc1388c0 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 1 -- 10.20.193.77:0/2605786452 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4007600 con 0x7f9fdc1388c0 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:15.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 10 monclient: dump: 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fd8d72640 4 set_mon_vals no callback set 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 5 monclient: authenticate success, global_id 4260 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 10 monclient: _renew_subs 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/2605786452 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fdc0a37b0 con 0x7f9fdc1388c0 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 10 monclient: _renew_subs 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/2605786452 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fdc121940 con 0x7f9fdc1388c0 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f4b63fff640 1 -- 10.20.193.77:0/2396097038 <== osd.3 v2:10.20.193.119:6801/3041501560 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f4b6c018e50 con 0x7f4b4403fd30 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7ffb4affd640 1 --2- 10.20.193.77:0/2892972488 >> v2:10.20.193.119:6800/4127986552 conn(0x7ffb1c03a2c0 0x7ffb1c03c780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0ab000 tx=0x7ffb3c004840 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/2605786452 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9fdc138380 con 0x7f9fdc1388c0 2026-02-17T12:05:15.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7fb840ff9640 1 -- 10.20.193.77:0/2560947117 <== osd.5 v2:10.20.193.119:6809/3174335982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fb814042760 con 0x7fb81403fc90 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 1 -- 10.20.193.77:0/2605786452 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f9fc401b400 con 0x7f9fdc1388c0 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 1 --2- 10.20.193.77:0/2605786452 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9fa803a1a0 0x7f9fa803c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 1 -- 10.20.193.77:0/2605786452 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f9fc404d800 con 0x7f9fdc1388c0 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 1 --2- 10.20.193.77:0/2605786452 >> v2:10.20.193.119:6805/4132502681 conn(0x7f9fa803fd30 0x7f9fa8042170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 1 -- 10.20.193.77:0/2605786452 --> v2:10.20.193.119:6805/4132502681 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9fa8042800 con 0x7f9fa803fd30 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 1 -- 10.20.193.77:0/2605786452 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9fc4054050 con 0x7f9fdc1388c0 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fc2ffd640 10 monclient: handle_get_version_reply finishing 1 version 20 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fdad76640 1 --2- 10.20.193.77:0/2605786452 >> v2:10.20.193.119:6805/4132502681 conn(0x7f9fa803fd30 0x7f9fa8042170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.115+0000 7f9fdad76640 10 monclient: get_auth_request con 0x7f9fa803fd30 auth_method 0 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7ffb4bfff640 1 --2- 10.20.193.77:0/2892972488 >> v2:10.20.193.77:6800/1107649769 conn(0x7ffb1c03fdd0 0x7ffb1c042210 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7ffb27fff640 1 -- 10.20.193.77:0/2892972488 <== osd.0 v2:10.20.193.77:6800/1107649769 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7ffb38012e50 con 0x7ffb1c03fdd0 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7f7972ffd640 1 --2- 10.20.193.77:0/3249348891 >> v2:10.20.193.77:6808/3812083705 conn(0x7f794403fc90 0x7f79440420d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/4285852188 --> v2:10.20.193.77:6801/662135547 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbcf4138b20 con 0x7fbcc403fbc0 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7f794ffff640 1 -- 10.20.193.77:0/3249348891 <== osd.2 v2:10.20.193.77:6808/3812083705 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f7944042760 con 0x7f794403fc90 2026-02-17T12:05:15.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcf0ff9640 1 -- 10.20.193.77:0/4285852188 <== osd.1 v2:10.20.193.77:6801/662135547 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbcf4138b20 con 0x7fbcc403fbc0 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/4285852188 >> v2:10.20.193.77:6801/662135547 conn(0x7fbcc403fbc0 msgr2=0x7fbcc4042000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcfaa0c640 1 --2- 10.20.193.77:0/4285852188 >> v2:10.20.193.77:6801/662135547 conn(0x7fbcc403fbc0 0x7fbcc4042000 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/4285852188 >> v2:10.20.193.119:6800/4127986552 conn(0x7fbcc403a120 msgr2=0x7fbcc403c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcfaa0c640 1 --2- 10.20.193.77:0/4285852188 >> v2:10.20.193.119:6800/4127986552 conn(0x7fbcc403a120 0x7fbcc403c5e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40a7cb0 tx=0x7fbce0004840 comp rx=0 tx=0).stop 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcfaa0c640 10 monclient: shutdown 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcfaa0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/4285852188 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbcf40a4c20 msgr2=0x7fbcf41d2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcfaa0c640 1 --2- 10.20.193.77:0/4285852188 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbcf40a4c20 0x7fbcf41d2970 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbce400c550 tx=0x7fbce400ca10 comp rx=0 tx=0).stop 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcf8f82640 1 -- 10.20.193.77:0/4285852188 reap_dead start 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/4285852188 shutdown_connections 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/4285852188 >> 10.20.193.77:0/4285852188 conn(0x7fbcf4074ba0 msgr2=0x7fbcf40a6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/4285852188 shutdown_connections 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.119+0000 7fbcfaa0c640 1 -- 10.20.193.77:0/4285852188 wait complete. 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f9fdad76640 1 --2- 10.20.193.77:0/2605786452 >> v2:10.20.193.119:6805/4132502681 conn(0x7f9fa803fd30 0x7f9fa8042170 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f9fc2ffd640 1 -- 10.20.193.77:0/2605786452 <== osd.4 v2:10.20.193.119:6805/4132502681 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f9fa8042800 con 0x7f9fa803fd30 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/2396097038 --> v2:10.20.193.119:6801/3041501560 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4b7806e2f0 con 0x7f4b4403fd30 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b63fff640 1 -- 10.20.193.77:0/2396097038 <== osd.3 v2:10.20.193.119:6801/3041501560 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4b7806e2f0 con 0x7f4b4403fd30 2026-02-17T12:05:15.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb84a4c8640 1 -- 10.20.193.77:0/2560947117 --> v2:10.20.193.119:6809/3174335982 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb84406c960 con 0x7fb81403fc90 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/2396097038 >> v2:10.20.193.119:6801/3041501560 conn(0x7f4b4403fd30 msgr2=0x7f4b44042170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b7cb4e640 1 --2- 10.20.193.77:0/2396097038 >> v2:10.20.193.119:6801/3041501560 conn(0x7f4b4403fd30 0x7f4b44042170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/2396097038 >> v2:10.20.193.119:6800/4127986552 conn(0x7f4b4403a1a0 msgr2=0x7f4b4403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b7cb4e640 1 --2- 10.20.193.77:0/2396097038 >> v2:10.20.193.119:6800/4127986552 conn(0x7f4b4403a1a0 0x7f4b4403c660 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009990 tx=0x7f4b64008040 comp rx=0 tx=0).stop 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b7cb4e640 10 monclient: shutdown 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b7cb4e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/2396097038 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4b7813d6d0 msgr2=0x7f4b78091e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b7cb4e640 1 --2- 10.20.193.77:0/2396097038 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f4b7813d6d0 0x7f4b78091e00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00be20 tx=0x7f4b6c00bf10 comp rx=0 tx=0).stop 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb840ff9640 1 -- 10.20.193.77:0/2560947117 <== osd.5 v2:10.20.193.119:6809/3174335982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb84406c960 con 0x7fb81403fc90 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b77fff640 1 -- 10.20.193.77:0/2396097038 reap_dead start 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/2396097038 shutdown_connections 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/2396097038 >> 10.20.193.77:0/2396097038 conn(0x7f4b780a76f0 msgr2=0x7f4b780a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/2396097038 shutdown_connections 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7f4b7cb4e640 1 -- 10.20.193.77:0/2396097038 wait complete. 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb84a4c8640 1 -- 10.20.193.77:0/2560947117 >> v2:10.20.193.119:6809/3174335982 conn(0x7fb81403fc90 msgr2=0x7fb8140420d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb84a4c8640 1 --2- 10.20.193.77:0/2560947117 >> v2:10.20.193.119:6809/3174335982 conn(0x7fb81403fc90 0x7fb8140420d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb84a4c8640 1 -- 10.20.193.77:0/2560947117 >> v2:10.20.193.119:6800/4127986552 conn(0x7fb81403a170 msgr2=0x7fb81403c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb84a4c8640 1 --2- 10.20.193.77:0/2560947117 >> v2:10.20.193.119:6800/4127986552 conn(0x7fb81403a170 0x7fb81403c630 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb844092ab0 tx=0x7fb834009040 comp rx=0 tx=0).stop 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb84a4c8640 10 monclient: shutdown 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb84a4c8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb84a4c8640 1 -- 10.20.193.77:0/2560947117 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb8440a0200 msgr2=0x7fb8441d2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb84a4c8640 1 --2- 10.20.193.77:0/2560947117 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb8440a0200 0x7fb8441d2170 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb83001c2b0 tx=0x7fb830019220 comp rx=0 tx=0).stop 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb848a3e640 1 -- 10.20.193.77:0/2560947117 reap_dead start 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb84a4c8640 1 -- 10.20.193.77:0/2560947117 shutdown_connections 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb84a4c8640 1 -- 10.20.193.77:0/2560947117 >> 10.20.193.77:0/2560947117 conn(0x7fb8440a4310 msgr2=0x7fb844070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb84a4c8640 1 -- 10.20.193.77:0/2560947117 shutdown_connections 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.123+0000 7fb84a4c8640 1 -- 10.20.193.77:0/2560947117 wait complete. 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2892972488 --> v2:10.20.193.77:6800/1107649769 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffb4c0a3a80 con 0x7ffb1c03fdd0 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb27fff640 1 -- 10.20.193.77:0/2892972488 <== osd.0 v2:10.20.193.77:6800/1107649769 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffb4c0a3a80 con 0x7ffb1c03fdd0 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2892972488 >> v2:10.20.193.77:6800/1107649769 conn(0x7ffb1c03fdd0 msgr2=0x7ffb1c042210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb51ecf640 1 --2- 10.20.193.77:0/2892972488 >> v2:10.20.193.77:6800/1107649769 conn(0x7ffb1c03fdd0 0x7ffb1c042210 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2892972488 >> v2:10.20.193.119:6800/4127986552 conn(0x7ffb1c03a2c0 msgr2=0x7ffb1c03c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb51ecf640 1 --2- 10.20.193.77:0/2892972488 >> v2:10.20.193.119:6800/4127986552 conn(0x7ffb1c03a2c0 0x7ffb1c03c780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0ab000 tx=0x7ffb3c004840 comp rx=0 tx=0).stop 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb51ecf640 10 monclient: shutdown 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb51ecf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2892972488 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb4c0a3290 msgr2=0x7ffb4c1d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb51ecf640 1 --2- 10.20.193.77:0/2892972488 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ffb4c0a3290 0x7ffb4c1d0010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800c580 tx=0x7ffb3800ca40 comp rx=0 tx=0).stop 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb4bfff640 1 -- 10.20.193.77:0/2892972488 reap_dead start 2026-02-17T12:05:15.199 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2892972488 shutdown_connections 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2892972488 >> 10.20.193.77:0/2892972488 conn(0x7ffb4c0a8a60 msgr2=0x7ffb4c0a7360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2892972488 shutdown_connections 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7ffb51ecf640 1 -- 10.20.193.77:0/2892972488 wait complete. 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f797a1f7640 1 -- 10.20.193.77:0/3249348891 --> v2:10.20.193.77:6808/3812083705 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7974096a00 con 0x7f794403fc90 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f794ffff640 1 -- 10.20.193.77:0/3249348891 <== osd.2 v2:10.20.193.77:6808/3812083705 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7974096a00 con 0x7f794403fc90 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f797a1f7640 1 -- 10.20.193.77:0/3249348891 >> v2:10.20.193.77:6808/3812083705 conn(0x7f794403fc90 msgr2=0x7f79440420d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f797a1f7640 1 --2- 10.20.193.77:0/3249348891 >> v2:10.20.193.77:6808/3812083705 conn(0x7f794403fc90 0x7f79440420d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f797a1f7640 1 -- 10.20.193.77:0/3249348891 >> v2:10.20.193.119:6800/4127986552 conn(0x7f794403a170 msgr2=0x7f794403c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f797a1f7640 1 --2- 10.20.193.77:0/3249348891 >> v2:10.20.193.119:6800/4127986552 conn(0x7f794403a170 0x7f794403c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f797a1f7640 10 monclient: shutdown 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f797a1f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f797a1f7640 1 -- 10.20.193.77:0/3249348891 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f7974132550 msgr2=0x7f7974140390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f797a1f7640 1 --2- 10.20.193.77:0/3249348891 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f7974132550 0x7f7974140390 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f796800be20 tx=0x7f796800bf10 comp rx=0 tx=0).stop 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f7973fff640 1 -- 10.20.193.77:0/3249348891 reap_dead start 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f797a1f7640 1 -- 10.20.193.77:0/3249348891 shutdown_connections 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f797a1f7640 1 -- 10.20.193.77:0/3249348891 >> 10.20.193.77:0/3249348891 conn(0x7f79740a4230 msgr2=0x7f797409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f797a1f7640 1 -- 10.20.193.77:0/3249348891 shutdown_connections 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.127+0000 7f797a1f7640 1 -- 10.20.193.77:0/3249348891 wait complete. 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/2605786452 --> v2:10.20.193.119:6805/4132502681 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9fdc13f770 con 0x7f9fa803fd30 2026-02-17T12:05:15.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fc2ffd640 1 -- 10.20.193.77:0/2605786452 <== osd.4 v2:10.20.193.119:6805/4132502681 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9fdc13f770 con 0x7f9fa803fd30 2026-02-17T12:05:15.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/2605786452 >> v2:10.20.193.119:6805/4132502681 conn(0x7f9fa803fd30 msgr2=0x7f9fa8042170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fe0fc5640 1 --2- 10.20.193.77:0/2605786452 >> v2:10.20.193.119:6805/4132502681 conn(0x7f9fa803fd30 0x7f9fa8042170 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/2605786452 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9fa803a1a0 msgr2=0x7f9fa803c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fe0fc5640 1 --2- 10.20.193.77:0/2605786452 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9fa803a1a0 0x7f9fa803c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fe0fc5640 10 monclient: shutdown 2026-02-17T12:05:15.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fe0fc5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/2605786452 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fdc1388c0 msgr2=0x7f9fdc137570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fe0fc5640 1 --2- 10.20.193.77:0/2605786452 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fdc1388c0 0x7f9fdc137570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400c570 tx=0x7f9fc400ca30 comp rx=0 tx=0).stop 2026-02-17T12:05:15.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fdad76640 1 -- 10.20.193.77:0/2605786452 reap_dead start 2026-02-17T12:05:15.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/2605786452 shutdown_connections 2026-02-17T12:05:15.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/2605786452 >> 10.20.193.77:0/2605786452 conn(0x7f9fdc074c20 msgr2=0x7f9fdc0a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/2605786452 shutdown_connections 2026-02-17T12:05:15.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.131+0000 7f9fe0fc5640 1 -- 10.20.193.77:0/2605786452 wait complete. 2026-02-17T12:05:15.201 INFO:teuthology.orchestra.run.trial077.stdout:51539607555 2026-02-17T12:05:15.201 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T12:05:15.202 INFO:teuthology.orchestra.run.trial077.stdout:51539607555 2026-02-17T12:05:15.202 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T12:05:15.202 INFO:teuthology.orchestra.run.trial077.stdout:55834574852 2026-02-17T12:05:15.202 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T12:05:15.203 INFO:teuthology.orchestra.run.trial077.stdout:47244640260 2026-02-17T12:05:15.203 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T12:05:15.203 INFO:teuthology.orchestra.run.trial077.stdout:51539607555 2026-02-17T12:05:15.203 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T12:05:15.203 INFO:teuthology.orchestra.run.trial077.stdout:51539607555 2026-02-17T12:05:15.203 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.299+0000 7f40f7e77640 10 monclient: get_monmap_and_config 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.299+0000 7f40f7e77640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.299+0000 7f40f7e77640 10 monclient: monmap: 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:15.304704+0000 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:15.304704+0000 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:15.302 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.299+0000 7f40f7e77640 1 Processor -- start 2026-02-17T12:05:15.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.299+0000 7f40f7e77640 1 -- start start 2026-02-17T12:05:15.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.299+0000 7f40f7e77640 10 monclient: init 2026-02-17T12:05:15.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f7e77640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f7e77640 10 monclient: _add_conns ranks=[0,2,4,1,3] 2026-02-17T12:05:15.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f7e77640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f40f009be20 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:15.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f7e77640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f00a4c20 0x7f40f013d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f7e77640 10 monclient(hunting): picked mon.noname-b con 0x7f40f00a4c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f7e77640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f40f00a5040 0x7f40f013f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f7e77640 10 monclient(hunting): picked mon.noname-c con 0x7f40f00a5040 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:15.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f7e77640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40f0135530 con 0x7f40f009be20 2026-02-17T12:05:15.304 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f7e77640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f7e77640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f40f009c200 con 0x7f40f00a5040 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f7e77640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f7e77640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f40f009cdf0 con 0x7f40f00a4c20 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f7e77640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f7e77640 10 monclient(hunting): authenticate will time out at 566.980166s 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f00a4c20 0x7f40f013d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f5bec640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f40f009be20 0x7f40f0134e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42382/0 (socket says 10.20.193.77:42382) 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 1 --2- 10.20.193.77:0/3023840626 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f00a4c20 0x7f40f013d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50720/0 (socket says 10.20.193.77:50720) 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f5bec640 1 -- 10.20.193.77:0/3023840626 learned_addr learned my addr 10.20.193.77:0/3023840626 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 10 monclient(hunting): get_auth_request con 0x7f40f00a4c20 auth_method 0 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f63ed640 1 --2- 10.20.193.77:0/3023840626 >> v2:10.20.193.119:3300/0 conn(0x7f40f00a5040 0x7f40f013f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f63ed640 10 monclient(hunting): get_auth_request con 0x7f40f00a5040 auth_method 0 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f63ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f63ed640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f63ed640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.305 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 10 monclient(hunting): handle_auth_done global_id 4241 payload 274 2026-02-17T12:05:15.306 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 1 -- 10.20.193.77:0/3023840626 >> v2:10.20.193.119:3300/0 conn(0x7f40f00a5040 msgr2=0x7f40f013f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.306 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 1 --2- 10.20.193.77:0/3023840626 >> v2:10.20.193.119:3300/0 conn(0x7f40f00a5040 0x7f40f013f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.306 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 1 -- 10.20.193.77:0/3023840626 >> v1:10.20.193.77:6789/0 conn(0x7f40f009be20 legacy=0x7f40f0134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.306 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.306 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 1 monclient: found mon.noname-b 2026-02-17T12:05:15.306 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.306 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.306 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 1 -- 10.20.193.77:0/3023840626 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f009d0d0 con 0x7f40f00a4c20 2026-02-17T12:05:15.306 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 10 monclient: get_monmap_and_config 2026-02-17T12:05:15.306 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.306 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 10 monclient: monmap: 2026-02-17T12:05:15.306 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.306 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.306 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:15.305940+0000 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:15.305940+0000 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 10 monclient: get_monmap_and_config 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 10 monclient: monmap: 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.307 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:15.306138+0000 2026-02-17T12:05:15.308 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:15.306138+0000 2026-02-17T12:05:15.308 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.308 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.308 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:15.308 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:15.308 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:15.308 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:15.308 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:15.308 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.308 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 1 Processor -- start 2026-02-17T12:05:15.308 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 1 Processor -- start 2026-02-17T12:05:15.308 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 1 -- start start 2026-02-17T12:05:15.309 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 10 monclient: init 2026-02-17T12:05:15.309 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 1 -- start start 2026-02-17T12:05:15.309 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 10 monclient: init 2026-02-17T12:05:15.309 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.309 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 10 monclient: _add_conns ranks=[3,1,2,4,0] 2026-02-17T12:05:15.309 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f63900a3290 0x7f6390138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.309 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.309 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2026-02-17T12:05:15.310 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 10 monclient(hunting): picked mon.noname-a con 0x7f63900a3290 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:15.310 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6390138b60 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:15.310 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f54d80a3290 0x7f54d8073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.310 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6390138f70 0x7f63900a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.310 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 10 monclient(hunting): picked mon.noname-b con 0x7f6390138f70 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.310 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f639006e860 con 0x7f6390138b60 2026-02-17T12:05:15.310 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.310 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f639006eb40 con 0x7f63900a3290 2026-02-17T12:05:15.310 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 10 monclient(hunting): picked mon.noname-b con 0x7f54d80a3290 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f54d80a3670 0x7f54d80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 10 monclient(hunting): picked mon.noname-c con 0x7f54d80a3670 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:15.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f54d8136050 0x7f54d8136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 10 monclient(hunting): picked mon.noname-a con 0x7f54d8136050 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:15.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f639006ee20 con 0x7f6390138f70 2026-02-17T12:05:15.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f6397c35640 10 monclient(hunting): authenticate will time out at 566.981735s 2026-02-17T12:05:15.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f54d80731c0 con 0x7f54d8136050 2026-02-17T12:05:15.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f54d80740e0 con 0x7f54d80a3670 2026-02-17T12:05:15.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f54d80a4a40 con 0x7f54d80a3290 2026-02-17T12:05:15.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54dc8cb640 10 monclient(hunting): authenticate will time out at 566.981741s 2026-02-17T12:05:15.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f63900a3290 0x7f6390138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f63900a3290 0x7f6390138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44436/0 (socket says 10.20.193.77:44436) 2026-02-17T12:05:15.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 1 -- 10.20.193.77:0/3220708351 learned_addr learned my addr 10.20.193.77:0/3220708351 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 10 monclient(hunting): get_auth_request con 0x7f63900a3290 auth_method 0 2026-02-17T12:05:15.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f54d80a3290 0x7f54d8073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6d76640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f54d8136050 0x7f54d8136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6d76640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f54d8136050 0x7f54d8136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44442/0 (socket says 10.20.193.77:44442) 2026-02-17T12:05:15.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6d76640 1 -- 10.20.193.77:0/831425256 learned_addr learned my addr 10.20.193.77:0/831425256 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d5d74640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f54d80a3670 0x7f54d80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6d76640 10 monclient(hunting): get_auth_request con 0x7f54d8136050 auth_method 0 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 10 monclient(hunting): get_auth_request con 0x7f54d80a3290 auth_method 0 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d5d74640 10 monclient(hunting): get_auth_request con 0x7f54d80a3670 auth_method 0 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 10 monclient(hunting): handle_auth_done global_id 4263 payload 274 2026-02-17T12:05:15.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 1 -- 10.20.193.77:0/3220708351 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6390138f70 msgr2=0x7f63900a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 1 --2- 10.20.193.77:0/3220708351 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6390138f70 0x7f63900a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 1 -- 10.20.193.77:0/3220708351 >> v1:10.20.193.119:6789/0 conn(0x7f6390138b60 legacy=0x7f63900a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 1 monclient: found mon.noname-a 2026-02-17T12:05:15.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f63959aa640 1 -- 10.20.193.77:0/3220708351 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63901393c0 con 0x7f63900a3290 2026-02-17T12:05:15.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 10 monclient(hunting): handle_auth_done global_id 4244 payload 274 2026-02-17T12:05:15.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 1 -- 10.20.193.77:0/831425256 >> v2:10.20.193.119:3300/0 conn(0x7f54d80a3670 msgr2=0x7f54d80a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 1 --2- 10.20.193.77:0/831425256 >> v2:10.20.193.119:3300/0 conn(0x7f54d80a3670 0x7f54d80a3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 1 -- 10.20.193.77:0/831425256 >> v2:10.20.193.77:3300/0 conn(0x7f54d8136050 msgr2=0x7f54d8136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 1 --2- 10.20.193.77:0/831425256 >> v2:10.20.193.77:3300/0 conn(0x7f54d8136050 0x7f54d8136500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 1 monclient: found mon.noname-b 2026-02-17T12:05:15.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6575640 1 -- 10.20.193.77:0/831425256 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d8072ee0 con 0x7f54d80a3290 2026-02-17T12:05:15.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f54d6d76640 1 --2- 10.20.193.77:0/831425256 >> v2:10.20.193.77:3300/0 conn(0x7f54d8136050 0x7f54d8136500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:15.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 1 -- 10.20.193.77:0/3023840626 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f00a4c20 msgr2=0x7f40f013d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f53eb640 1 --2- 10.20.193.77:0/3023840626 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f00a4c20 0x7f40f013d470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f40e40098c0 tx=0x7f40e401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa78f2092ad34da7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f4bea640 1 -- 10.20.193.77:0/3023840626 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e40b1070 con 0x7f40f00a4c20 2026-02-17T12:05:15.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f4bea640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f4bea640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f4bea640 10 monclient: dump: 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f4bea640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f4bea640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f4bea640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.303+0000 7f40f4bea640 1 -- 10.20.193.77:0/3023840626 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e40ac640 con 0x7f40f00a4c20 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 5 monclient: authenticate success, global_id 4241 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f4bea640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 4 set_mon_vals no callback set 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f4bea640 1 -- 10.20.193.77:0/3023840626 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e40aca10 con 0x7f40f00a4c20 2026-02-17T12:05:15.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f4bea640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f4bea640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f4bea640 10 monclient: dump: 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient: shutdown 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 -- 10.20.193.77:0/3023840626 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f00a4c20 msgr2=0x7f40f013d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 --2- 10.20.193.77:0/3023840626 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f00a4c20 0x7f40f013d470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f40e40098c0 tx=0x7f40e401c480 comp rx=0 tx=0).stop 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 -- 10.20.193.77:0/3023840626 shutdown_connections 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 --2- 10.20.193.77:0/3023840626 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f00a4c20 0x7f40f013d470 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 --2- 10.20.193.77:0/3023840626 >> v2:10.20.193.119:3300/0 conn(0x7f40f00a5040 0x7f40f013f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 -- 10.20.193.77:0/3023840626 >> 10.20.193.77:0/3023840626 conn(0x7f40f0074ba0 msgr2=0x7f40f00aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 -- 10.20.193.77:0/3023840626 shutdown_connections 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 -- 10.20.193.77:0/3023840626 wait complete. 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient: monmap: 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 Processor -- start 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 -- start start 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient: init 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f009be20 0x7f40f01d2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient(hunting): picked mon.noname-c con 0x7f40f009be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40f00a4c20 0x7f40f01d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient(hunting): picked mon.noname-b con 0x7f40f00a4c20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f40f00a5040 0x7f40f013e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient(hunting): picked mon.noname-a con 0x7f40f00a5040 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f40f0142ab0 con 0x7f40f00a5040 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f40f0142930 con 0x7f40f00a4c20 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f40f0142c30 con 0x7f40f009be20 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient(hunting): authenticate will time out at 566.985180s 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f009be20 0x7f40f01d2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f009be20 0x7f40f01d2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50748/0 (socket says 10.20.193.77:50748) 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 1 -- 10.20.193.77:0/447417485 learned_addr learned my addr 10.20.193.77:0/447417485 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 10 monclient(hunting): get_auth_request con 0x7f40f009be20 auth_method 0 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f53eb640 1 --2- 10.20.193.77:0/447417485 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40f00a4c20 0x7f40f01d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6575640 1 -- 10.20.193.77:0/831425256 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f54d80a3290 msgr2=0x7f54d8073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6575640 1 --2- 10.20.193.77:0/831425256 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f54d80a3290 0x7f54d8073ba0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f54d80686c0 tx=0x7f54cc01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dedaf7b27820116 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 1 -- 10.20.193.77:0/3220708351 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f63900a3290 msgr2=0x7f6390138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 1 --2- 10.20.193.77:0/3220708351 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f63900a3290 0x7f6390138620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6380009970 tx=0x7f638001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54138a81cd87ec6b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f53eb640 10 monclient(hunting): get_auth_request con 0x7f40f00a4c20 auth_method 0 2026-02-17T12:05:15.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f53eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f53eb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f53eb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 10 monclient(hunting): handle_auth_done global_id 4247 payload 824 2026-02-17T12:05:15.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 1 -- 10.20.193.77:0/447417485 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40f00a4c20 msgr2=0x7f40f01d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 1 --2- 10.20.193.77:0/447417485 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40f00a4c20 0x7f40f01d29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 1 -- 10.20.193.77:0/447417485 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f40f00a5040 msgr2=0x7f40f013e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 1 --2- 10.20.193.77:0/447417485 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f40f00a5040 0x7f40f013e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 1 monclient: found mon.noname-c 2026-02-17T12:05:15.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 1 -- 10.20.193.77:0/447417485 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f009e4f0 con 0x7f40f009be20 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63949a8640 1 -- 10.20.193.77:0/3220708351 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63800b0070 con 0x7f63900a3290 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63949a8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63949a8640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63949a8640 10 monclient: dump: 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63949a8640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63949a8640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63949a8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63949a8640 1 -- 10.20.193.77:0/3220708351 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6380004230 con 0x7f63900a3290 2026-02-17T12:05:15.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63949a8640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63949a8640 1 -- 10.20.193.77:0/3220708351 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380003720 con 0x7f63900a3290 2026-02-17T12:05:15.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 5 monclient: authenticate success, global_id 4263 2026-02-17T12:05:15.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:15.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 4 set_mon_vals no callback set 2026-02-17T12:05:15.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63949a8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63949a8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:15.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5573640 1 -- 10.20.193.77:0/831425256 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0aa430 con 0x7f54d80a3290 2026-02-17T12:05:15.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:15.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63949a8640 10 monclient: dump: 2026-02-17T12:05:15.328 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.328 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.329 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.329 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.329 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.329 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.329 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.329 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.329 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.329 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.329 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5573640 10 monclient: dump: 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5573640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5573640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5573640 1 -- 10.20.193.77:0/831425256 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54cc0af070 con 0x7f54d80a3290 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5573640 1 -- 10.20.193.77:0/831425256 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0aa7f0 con 0x7f54d80a3290 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 5 monclient: authenticate success, global_id 4244 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:15.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 4 set_mon_vals no callback set 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5573640 10 monclient: dump: 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient: shutdown 2026-02-17T12:05:15.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 -- 10.20.193.77:0/3220708351 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f63900a3290 msgr2=0x7f6390138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 --2- 10.20.193.77:0/3220708351 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f63900a3290 0x7f6390138620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6380009970 tx=0x7f638001c540 comp rx=0 tx=0).stop 2026-02-17T12:05:15.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 -- 10.20.193.77:0/3220708351 shutdown_connections 2026-02-17T12:05:15.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 --2- 10.20.193.77:0/3220708351 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6390138f70 0x7f63900a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 --2- 10.20.193.77:0/3220708351 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f63900a3290 0x7f6390138620 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 -- 10.20.193.77:0/3220708351 >> 10.20.193.77:0/3220708351 conn(0x7f63900a8a60 msgr2=0x7f63900a8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient: shutdown 2026-02-17T12:05:15.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 -- 10.20.193.77:0/831425256 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f54d80a3290 msgr2=0x7f54d8073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 --2- 10.20.193.77:0/831425256 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f54d80a3290 0x7f54d8073ba0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f54d80686c0 tx=0x7f54cc01c4b0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 -- 10.20.193.77:0/3220708351 shutdown_connections 2026-02-17T12:05:15.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 -- 10.20.193.77:0/3220708351 wait complete. 2026-02-17T12:05:15.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 -- 10.20.193.77:0/831425256 shutdown_connections 2026-02-17T12:05:15.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 --2- 10.20.193.77:0/831425256 >> v2:10.20.193.77:3300/0 conn(0x7f54d8136050 0x7f54d8136500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 --2- 10.20.193.77:0/831425256 >> v2:10.20.193.119:3300/0 conn(0x7f54d80a3670 0x7f54d80a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 --2- 10.20.193.77:0/831425256 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f54d80a3290 0x7f54d8073ba0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 -- 10.20.193.77:0/831425256 >> 10.20.193.77:0/831425256 conn(0x7f54d80a8a60 msgr2=0x7f54d80a8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 -- 10.20.193.77:0/831425256 shutdown_connections 2026-02-17T12:05:15.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 -- 10.20.193.77:0/831425256 wait complete. 2026-02-17T12:05:15.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 10 monclient: get_monmap_and_config 2026-02-17T12:05:15.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 10 monclient: monmap: 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:15.311361+0000 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:15.311361+0000 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient: monmap: 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:15.334 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.335 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.335 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:15.335 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:15.335 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:15.335 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 1 Processor -- start 2026-02-17T12:05:15.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 1 -- start start 2026-02-17T12:05:15.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 10 monclient: init 2026-02-17T12:05:15.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient: monmap: 2026-02-17T12:05:15.336 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.336 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:15.336 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:15.336 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:15.336 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.336 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.336 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:15.336 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:15.336 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:15.336 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 Processor -- start 2026-02-17T12:05:15.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 -- start start 2026-02-17T12:05:15.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient: init 2026-02-17T12:05:15.337 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 Processor -- start 2026-02-17T12:05:15.337 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.337 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2026-02-17T12:05:15.337 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a07d0 0x7f10780a2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.337 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 10 monclient(hunting): picked mon.noname-b con 0x7f10780a07d0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.337 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 -- start start 2026-02-17T12:05:15.337 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient: init 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f10780a2750 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f10780a2b30 0x7f107813e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 10 monclient(hunting): picked mon.noname-c con 0x7f10780a2b30 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f107809d4a0 con 0x7f10780a2750 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f107809ed40 con 0x7f10780a2b30 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f107809ea60 con 0x7f10780a07d0 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107e674640 10 monclient(hunting): authenticate will time out at 566.986788s 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a07d0 0x7f10780a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a07d0 0x7f10780a2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50752/0 (socket says 10.20.193.77:50752) 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 1 -- 10.20.193.77:0/2409753432 learned_addr learned my addr 10.20.193.77:0/2409753432 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 10 monclient(hunting): get_auth_request con 0x7f10780a07d0 auth_method 0 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.338 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:05:15.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107cbea640 1 --2- 10.20.193.77:0/2409753432 >> v2:10.20.193.119:3300/0 conn(0x7f10780a2b30 0x7f107813e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f63900a3290 0x7f63901378f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient(hunting): picked mon.noname-a con 0x7f63900a3290 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:15.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6390138b60 0x7f6390137e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:05:15.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f54d80a3290 0x7f54d81d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient(hunting): picked mon.noname-b con 0x7f54d80a3290 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:15.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient(hunting): picked mon.noname-b con 0x7f6390138b60 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:15.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6390138f70 0x7f63901d2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f54d80a3670 0x7f54d8135350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient(hunting): picked mon.noname-a con 0x7f54d80a3670 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:15.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f54d8136050 0x7f54d813b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient(hunting): picked mon.noname-c con 0x7f54d8136050 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f54d8072490 con 0x7f54d80a3670 2026-02-17T12:05:15.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient(hunting): picked mon.noname-c con 0x7f6390138f70 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f63901434a0 con 0x7f63900a3290 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6390143320 con 0x7f6390138b60 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6390143620 con 0x7f6390138f70 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f54d8072310 con 0x7f54d80a3290 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f54d813fd40 con 0x7f54d8136050 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54dc8cb640 10 monclient(hunting): authenticate will time out at 566.987050s 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107cbea640 10 monclient(hunting): get_auth_request con 0x7f10780a2b30 auth_method 0 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107cbea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107cbea640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f107cbea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 10 monclient(hunting): handle_auth_done global_id 4250 payload 274 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 1 -- 10.20.193.77:0/2409753432 >> v2:10.20.193.119:3300/0 conn(0x7f10780a2b30 msgr2=0x7f107813e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 1 --2- 10.20.193.77:0/2409753432 >> v2:10.20.193.119:3300/0 conn(0x7f10780a2b30 0x7f107813e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f6397c35640 10 monclient(hunting): authenticate will time out at 566.987050s 2026-02-17T12:05:15.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 1 -- 10.20.193.77:0/2409753432 >> v1:10.20.193.119:6789/0 conn(0x7f10780a2750 legacy=0x7f107813a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 1 monclient: found mon.noname-b 2026-02-17T12:05:15.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f1077fff640 1 -- 10.20.193.77:0/2409753432 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10780a2fa0 con 0x7f10780a07d0 2026-02-17T12:05:15.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f63900a3290 0x7f63901378f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f63900a3290 0x7f63901378f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44454/0 (socket says 10.20.193.77:44454) 2026-02-17T12:05:15.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 1 -- 10.20.193.77:0/2137636484 learned_addr learned my addr 10.20.193.77:0/2137636484 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 10 monclient(hunting): get_auth_request con 0x7f63900a3290 auth_method 0 2026-02-17T12:05:15.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5d74640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f54d80a3670 0x7f54d8135350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f54d8136050 0x7f54d813b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5d74640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f54d80a3670 0x7f54d8135350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44464/0 (socket says 10.20.193.77:44464) 2026-02-17T12:05:15.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5d74640 1 -- 10.20.193.77:0/1777797534 learned_addr learned my addr 10.20.193.77:0/1777797534 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5d74640 10 monclient(hunting): get_auth_request con 0x7f54d80a3670 auth_method 0 2026-02-17T12:05:15.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.344 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.344 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 10 monclient(hunting): get_auth_request con 0x7f54d8136050 auth_method 0 2026-02-17T12:05:15.344 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.344 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.344 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.344 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.344 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.344 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.344 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.344 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.344 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.344 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 10 monclient(hunting): handle_auth_done global_id 4269 payload 824 2026-02-17T12:05:15.344 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 1 -- 10.20.193.77:0/2137636484 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6390138f70 msgr2=0x7f63901d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.344 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 1 --2- 10.20.193.77:0/2137636484 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6390138f70 0x7f63901d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 1 -- 10.20.193.77:0/2137636484 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6390138b60 msgr2=0x7f6390137e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 1 --2- 10.20.193.77:0/2137636484 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6390138b60 0x7f6390137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 1 monclient: found mon.noname-a 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f63959aa640 1 -- 10.20.193.77:0/2137636484 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6390073e50 con 0x7f63900a3290 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 10 monclient(hunting): handle_auth_done global_id 4253 payload 824 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 1 -- 10.20.193.77:0/1777797534 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f54d80a3290 msgr2=0x7f54d81d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 1 --2- 10.20.193.77:0/1777797534 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f54d80a3290 0x7f54d81d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 1 -- 10.20.193.77:0/1777797534 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f54d80a3670 msgr2=0x7f54d8135350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 1 --2- 10.20.193.77:0/1777797534 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f54d80a3670 0x7f54d8135350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 1 monclient: found mon.noname-c 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d6d76640 1 -- 10.20.193.77:0/1777797534 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d813d010 con 0x7f54d8136050 2026-02-17T12:05:15.345 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f54d5d74640 1 --2- 10.20.193.77:0/1777797534 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f54d80a3670 0x7f54d8135350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 1 -- 10.20.193.77:0/447417485 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f009be20 msgr2=0x7f40f01d2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f5bec640 1 --2- 10.20.193.77:0/447417485 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f009be20 0x7f40f01d2480 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f40e000c570 tx=0x7f40e000ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40de7fc640 1 -- 10.20.193.77:0/447417485 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0007070 con 0x7f40f009be20 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40de7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40de7fc640 10 monclient: dump: 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.346 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40de7fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40de7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40de7fc640 1 -- 10.20.193.77:0/447417485 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e0007210 con 0x7f40f009be20 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 5 monclient: authenticate success, global_id 4247 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient: _renew_subs 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 -- 10.20.193.77:0/447417485 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f006f590 con 0x7f40f009be20 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40de7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40de7fc640 1 -- 10.20.193.77:0/447417485 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0007600 con 0x7f40f009be20 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40de7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40de7fc640 10 monclient: dump: 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40dffff640 4 set_mon_vals no callback set 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient: _renew_subs 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.307+0000 7f40f7e77640 1 -- 10.20.193.77:0/447417485 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f009fc60 con 0x7f40f009be20 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f40f7e77640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f40f7e77640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f40f7e77640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.347 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f40f7e77640 1 -- 10.20.193.77:0/447417485 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f0134e00 con 0x7f40f009be20 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f40de7fc640 1 -- 10.20.193.77:0/447417485 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f40e001b400 con 0x7f40f009be20 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 10 monclient: get_monmap_and_config 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 10 monclient: monmap: 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:15.313705+0000 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:15.313705+0000 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f40de7fc640 1 --2- 10.20.193.77:0/447417485 >> v2:10.20.193.119:6800/4127986552 conn(0x7f40c003a170 0x7f40c003c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.348 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f40de7fc640 1 -- 10.20.193.77:0/447417485 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f40e004d780 con 0x7f40f009be20 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 10 monclient: get_monmap_and_config 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 10 monclient: monmap: 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:15.313757+0000 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:15.313757+0000 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f40f53eb640 1 --2- 10.20.193.77:0/447417485 >> v2:10.20.193.119:6800/4127986552 conn(0x7f40c003a170 0x7f40c003c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f40f53eb640 10 monclient: get_auth_request con 0x7f40c003a170 auth_method 0 2026-02-17T12:05:15.349 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 1 Processor -- start 2026-02-17T12:05:15.350 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 1 Processor -- start 2026-02-17T12:05:15.350 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 1 -- start start 2026-02-17T12:05:15.350 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 10 monclient: init 2026-02-17T12:05:15.350 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 1 -- start start 2026-02-17T12:05:15.350 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 10 monclient: init 2026-02-17T12:05:15.350 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.350 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 10 monclient: _add_conns ranks=[4,3,1,0,2] 2026-02-17T12:05:15.350 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0a6c0a89c0 0x7f0a6c138380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.350 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 10 monclient(hunting): picked mon.noname-c con 0x7f0a6c0a89c0 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:15.350 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f0a6c1388c0 0x7f0a6c138cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.350 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 10 monclient(hunting): picked mon.noname-a con 0x7f0a6c1388c0 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:15.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0a6c0a8da0 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:15.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a6c0aa3f0 con 0x7f0a6c0a8da0 2026-02-17T12:05:15.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 10 monclient: _add_conns ranks=[2,0,4,1,3] 2026-02-17T12:05:15.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af409be20 0x7f3af4134e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0a6c0a4680 con 0x7f0a6c1388c0 2026-02-17T12:05:15.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0a6c0aa630 con 0x7f0a6c0a89c0 2026-02-17T12:05:15.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 10 monclient(hunting): picked mon.noname-b con 0x7f3af409be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a73f23640 10 monclient(hunting): authenticate will time out at 566.989183s 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3af40a4c20 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f3af40a5040 0x7f3af4138800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 10 monclient(hunting): picked mon.noname-c con 0x7f3af40a5040 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3af409cdf0 con 0x7f3af40a4c20 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f3af409c200 con 0x7f3af40a5040 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3af409d0d0 con 0x7f3af409be20 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f0a6c1388c0 0x7f0a6c138cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3afb9ce640 10 monclient(hunting): authenticate will time out at 566.989260s 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f0a6c1388c0 0x7f0a6c138cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44478/0 (socket says 10.20.193.77:44478) 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 1 -- 10.20.193.77:0/96626215 learned_addr learned my addr 10.20.193.77:0/96626215 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 10 monclient(hunting): get_auth_request con 0x7f0a6c1388c0 auth_method 0 2026-02-17T12:05:15.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af8f42640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f3af40a4c20 0x7f3af41380f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42388/0 (socket says 10.20.193.77:42388) 2026-02-17T12:05:15.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af8f42640 1 -- 10.20.193.77:0/3866263308 learned_addr learned my addr 10.20.193.77:0/3866263308 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:15.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71c98640 1 --2- 10.20.193.77:0/96626215 >> v2:10.20.193.119:3300/0 conn(0x7f0a6c0a89c0 0x7f0a6c138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 10 monclient(hunting): handle_auth_done global_id 4275 payload 274 2026-02-17T12:05:15.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 1 -- 10.20.193.77:0/96626215 >> v2:10.20.193.119:3300/0 conn(0x7f0a6c0a89c0 msgr2=0x7f0a6c138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 1 --2- 10.20.193.77:0/96626215 >> v2:10.20.193.119:3300/0 conn(0x7f0a6c0a89c0 0x7f0a6c138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 1 -- 10.20.193.77:0/96626215 >> v1:10.20.193.119:6789/0 conn(0x7f0a6c0a8da0 legacy=0x7f0a6c0a91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 1 monclient: found mon.noname-a 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71497640 1 -- 10.20.193.77:0/96626215 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6c09ce80 con 0x7f0a6c1388c0 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71c98640 10 monclient: get_auth_request con 0x7f0a6c0a89c0 auth_method 0 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f0a71c98640 1 --2- 10.20.193.77:0/96626215 >> v2:10.20.193.119:3300/0 conn(0x7f0a6c0a89c0 0x7f0a6c138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f63959aa640 1 -- 10.20.193.77:0/2137636484 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f63900a3290 msgr2=0x7f63901378f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f63959aa640 1 --2- 10.20.193.77:0/2137636484 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f63900a3290 0x7f63901378f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f638001abf0 tx=0x7f63800192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54d6d76640 1 -- 10.20.193.77:0/1777797534 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f54d8136050 msgr2=0x7f54d813b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54d6d76640 1 --2- 10.20.193.77:0/1777797534 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f54d8136050 0x7f54d813b370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f54c8009e50 tx=0x7f54c800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 1 --2- 10.20.193.77:0/3866263308 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af409be20 0x7f3af4134e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 1 -- 10.20.193.77:0/2137636484 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63800b9070 con 0x7f63900a3290 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 10 monclient: dump: 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.354 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 1 -- 10.20.193.77:0/2137636484 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6380003d50 con 0x7f63900a3290 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 10 monclient(hunting): get_auth_request con 0x7f3af409be20 auth_method 0 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 1 -- 10.20.193.77:0/2137636484 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63800b0040 con 0x7f63900a3290 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 10 monclient: dump: 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.355 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.356 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637ffff640 4 set_mon_vals no callback set 2026-02-17T12:05:15.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f6397c35640 5 monclient: authenticate success, global_id 4269 2026-02-17T12:05:15.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f6397c35640 10 monclient: _renew_subs 2026-02-17T12:05:15.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f6397c35640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f6397c35640 1 -- 10.20.193.77:0/2137636484 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639009fa80 con 0x7f63900a3290 2026-02-17T12:05:15.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f6397c35640 10 monclient: _renew_subs 2026-02-17T12:05:15.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f6397c35640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f6397c35640 1 -- 10.20.193.77:0/2137636484 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f639013f240 con 0x7f63900a3290 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 10 monclient(hunting): handle_auth_done global_id 4256 payload 274 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 1 -- 10.20.193.77:0/3866263308 >> v2:10.20.193.119:3300/0 conn(0x7f3af40a5040 msgr2=0x7f3af4138800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 1 --2- 10.20.193.77:0/3866263308 >> v2:10.20.193.119:3300/0 conn(0x7f3af40a5040 0x7f3af4138800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 1 -- 10.20.193.77:0/3866263308 >> v1:10.20.193.77:6789/0 conn(0x7f3af40a4c20 legacy=0x7f3af41380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 1 monclient: found mon.noname-b 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f3af9743640 1 -- 10.20.193.77:0/3866263308 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af409d3b0 con 0x7f3af409be20 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f6397c35640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f6397c35640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f6397c35640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f6397c35640 1 -- 10.20.193.77:0/2137636484 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6390138620 con 0x7f63900a3290 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 1 -- 10.20.193.77:0/2137636484 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f63800ab6a0 con 0x7f63900a3290 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 1 --2- 10.20.193.77:0/2137636484 >> v2:10.20.193.119:6800/4127986552 conn(0x7f636003a1a0 0x7f636003c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1077fff640 1 -- 10.20.193.77:0/2409753432 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a07d0 msgr2=0x7f10780a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1077fff640 1 --2- 10.20.193.77:0/2409753432 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a07d0 0x7f10780a2210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1064009970 tx=0x7f106401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26f845b3cf6faba8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f637e7fc640 1 -- 10.20.193.77:0/2137636484 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f63800e7db0 con 0x7f63900a3290 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 1 -- 10.20.193.77:0/1777797534 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c800cd10 con 0x7f54d8136050 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 10 monclient: dump: 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 1 -- 10.20.193.77:0/1777797534 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c8003aa0 con 0x7f54d8136050 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54dc8cb640 5 monclient: authenticate success, global_id 4253 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54dc8cb640 10 monclient: _renew_subs 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54dc8cb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54dc8cb640 1 -- 10.20.193.77:0/1777797534 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d81d0fc0 con 0x7f54d8136050 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 1 -- 10.20.193.77:0/1777797534 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c8004020 con 0x7f54d8136050 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:15.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 10 monclient: dump: 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54d4d72640 4 set_mon_vals no callback set 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54dc8cb640 10 monclient: _renew_subs 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54dc8cb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54dc8cb640 1 -- 10.20.193.77:0/1777797534 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d8120730 con 0x7f54d8136050 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1076ffd640 1 -- 10.20.193.77:0/2409753432 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10640b1070 con 0x7f10780a07d0 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1076ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1076ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1076ffd640 10 monclient: dump: 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1076ffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1076ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1076ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f63951a9640 1 --2- 10.20.193.77:0/2137636484 >> v2:10.20.193.119:6800/4127986552 conn(0x7f636003a1a0 0x7f636003c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1076ffd640 1 -- 10.20.193.77:0/2409753432 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1064004230 con 0x7f10780a07d0 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1076ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1076ffd640 1 -- 10.20.193.77:0/2409753432 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10640a8050 con 0x7f10780a07d0 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 5 monclient: authenticate success, global_id 4250 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 4 set_mon_vals no callback set 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1076ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1076ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f1076ffd640 10 monclient: dump: 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f63951a9640 10 monclient: get_auth_request con 0x7f636003a1a0 auth_method 0 2026-02-17T12:05:15.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f40de7fc640 1 -- 10.20.193.77:0/447417485 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f40e001b9b0 con 0x7f40f009be20 2026-02-17T12:05:15.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f40de7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f40de7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:15.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient: shutdown 2026-02-17T12:05:15.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 -- 10.20.193.77:0/2409753432 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a07d0 msgr2=0x7f10780a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 --2- 10.20.193.77:0/2409753432 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a07d0 0x7f10780a2210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1064009970 tx=0x7f106401c540 comp rx=0 tx=0).stop 2026-02-17T12:05:15.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 -- 10.20.193.77:0/2409753432 shutdown_connections 2026-02-17T12:05:15.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 --2- 10.20.193.77:0/2409753432 >> v2:10.20.193.119:3300/0 conn(0x7f10780a2b30 0x7f107813e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 --2- 10.20.193.77:0/2409753432 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a07d0 0x7f10780a2210 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 -- 10.20.193.77:0/2409753432 >> 10.20.193.77:0/2409753432 conn(0x7f10780a73c0 msgr2=0x7f10780a3300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 -- 10.20.193.77:0/2409753432 shutdown_connections 2026-02-17T12:05:15.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 -- 10.20.193.77:0/2409753432 wait complete. 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54dc8cb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54dc8cb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54dc8cb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54dc8cb640 1 -- 10.20.193.77:0/1777797534 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d80a3a50 con 0x7f54d8136050 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 1 -- 10.20.193.77:0/1777797534 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f54c80041c0 con 0x7f54d8136050 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient: monmap: 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 1 --2- 10.20.193.77:0/1777797534 >> v2:10.20.193.119:6800/4127986552 conn(0x7f54a403a170 0x7f54a403c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f54beffd640 1 -- 10.20.193.77:0/1777797534 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f54c804de50 con 0x7f54d8136050 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 Processor -- start 2026-02-17T12:05:15.362 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 -- start start 2026-02-17T12:05:15.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient: init 2026-02-17T12:05:15.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f40f53eb640 1 --2- 10.20.193.77:0/447417485 >> v2:10.20.193.119:6800/4127986552 conn(0x7f40c003a170 0x7f40c003c630 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f40f00750e0 tx=0x7f40e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:05:15.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f10780a07d0 0x7f10780996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient(hunting): picked mon.noname-a con 0x7f10780a07d0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:15.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a2750 0x7f1078092f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient(hunting): picked mon.noname-c con 0x7f10780a2750 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f10780a2b30 0x7f1078093480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient(hunting): picked mon.noname-b con 0x7f10780a2b30 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f10780a0d30 con 0x7f10780a07d0 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f10780a0bb0 con 0x7f10780a2b30 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f107809f720 con 0x7f10780a2750 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f107e674640 10 monclient(hunting): authenticate will time out at 566.991849s 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f10777fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a2750 0x7f1078092f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f10777fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a2750 0x7f1078092f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50778/0 (socket says 10.20.193.77:50778) 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f10777fe640 1 -- 10.20.193.77:0/2426938122 learned_addr learned my addr 10.20.193.77:0/2426938122 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f10777fe640 10 monclient(hunting): get_auth_request con 0x7f10780a2750 auth_method 0 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f10777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f10777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f10777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f10777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f10777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.311+0000 7f10777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107cbea640 1 --2- 10.20.193.77:0/2426938122 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f10780a2b30 0x7f1078093480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107cbea640 10 monclient(hunting): get_auth_request con 0x7f10780a2b30 auth_method 0 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107cbea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107cbea640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107cbea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f10777fe640 10 monclient(hunting): handle_auth_done global_id 4259 payload 824 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f10777fe640 1 -- 10.20.193.77:0/2426938122 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f10780a2b30 msgr2=0x7f1078093480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f10777fe640 1 --2- 10.20.193.77:0/2426938122 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f10780a2b30 0x7f1078093480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f10777fe640 1 -- 10.20.193.77:0/2426938122 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f10780a07d0 msgr2=0x7f10780996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f10777fe640 1 --2- 10.20.193.77:0/2426938122 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f10780a07d0 0x7f10780996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f10777fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f10777fe640 1 monclient: found mon.noname-c 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f10777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f10777fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f10777fe640 1 -- 10.20.193.77:0/2426938122 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1078096870 con 0x7f10780a2750 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f637e7fc640 1 -- 10.20.193.77:0/2137636484 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f6380016250 con 0x7f63900a3290 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f637e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f637e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71497640 1 -- 10.20.193.77:0/96626215 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a6c1388c0 msgr2=0x7f0a6c138cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71497640 1 --2- 10.20.193.77:0/96626215 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a6c1388c0 0x7f0a6c138cf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0ab7d0 tx=0x7f0a6001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4feb65488ee0b908 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a70c96640 1 -- 10.20.193.77:0/96626215 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a600b0070 con 0x7f0a6c1388c0 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a70c96640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a70c96640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a70c96640 10 monclient: dump: 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a70c96640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a70c96640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a70c96640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a70c96640 1 -- 10.20.193.77:0/96626215 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a60004230 con 0x7f0a6c1388c0 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a70c96640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a70c96640 1 -- 10.20.193.77:0/96626215 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a60003720 con 0x7f0a6c1388c0 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 5 monclient: authenticate success, global_id 4275 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 4 set_mon_vals no callback set 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a70c96640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a70c96640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a70c96640 10 monclient: dump: 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f63951a9640 1 --2- 10.20.193.77:0/2137636484 >> v2:10.20.193.119:6800/4127986552 conn(0x7f636003a1a0 0x7f636003c660 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6384007fd0 tx=0x7f6384007ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f54d6575640 1 --2- 10.20.193.77:0/1777797534 >> v2:10.20.193.119:6800/4127986552 conn(0x7f54a403a170 0x7f54a403c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f54d6575640 10 monclient: get_auth_request con 0x7f54a403a170 auth_method 0 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af9743640 1 -- 10.20.193.77:0/3866263308 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af409be20 msgr2=0x7f3af4134e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.366 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af9743640 1 --2- 10.20.193.77:0/3866263308 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af409be20 0x7f3af4134e20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40098c0 tx=0x7f3ae401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7e1024fab3d1977 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient: shutdown 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 -- 10.20.193.77:0/96626215 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a6c1388c0 msgr2=0x7f0a6c138cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 --2- 10.20.193.77:0/96626215 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a6c1388c0 0x7f0a6c138cf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0ab7d0 tx=0x7f0a6001c500 comp rx=0 tx=0).stop 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 -- 10.20.193.77:0/96626215 shutdown_connections 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 --2- 10.20.193.77:0/96626215 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a6c1388c0 0x7f0a6c138cf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 --2- 10.20.193.77:0/96626215 >> v2:10.20.193.119:3300/0 conn(0x7f0a6c0a89c0 0x7f0a6c138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 -- 10.20.193.77:0/96626215 >> 10.20.193.77:0/96626215 conn(0x7f0a6c074c20 msgr2=0x7f0a6c0aabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 -- 10.20.193.77:0/96626215 shutdown_connections 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 -- 10.20.193.77:0/96626215 wait complete. 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient: monmap: 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 Processor -- start 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3ae3fff640 1 -- 10.20.193.77:0/3866263308 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40b1070 con 0x7f3af409be20 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3ae3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3ae3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3ae3fff640 10 monclient: dump: 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.367 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 -- start start 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient: init 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3ae3fff640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3ae3fff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3ae3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3ae3fff640 1 -- 10.20.193.77:0/3866263308 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae40ac640 con 0x7f3af409be20 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3ae3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3ae3fff640 1 -- 10.20.193.77:0/3866263308 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40aca10 con 0x7f3af409be20 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 5 monclient: authenticate success, global_id 4256 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 4 set_mon_vals no callback set 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3ae3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3ae3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3ae3fff640 10 monclient: dump: 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f10777fe640 1 -- 10.20.193.77:0/2426938122 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a2750 msgr2=0x7f1078092f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.368 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f10777fe640 1 --2- 10.20.193.77:0/2426938122 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a2750 0x7f1078092f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f106800c580 tx=0x7f106800ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f54beffd640 1 -- 10.20.193.77:0/1777797534 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f54c8022020 con 0x7f54d8136050 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f54beffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f54beffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 1 -- 10.20.193.77:0/2426938122 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068016020 con 0x7f10780a2750 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 10 monclient: dump: 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 1 -- 10.20.193.77:0/2426938122 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1068012a60 con 0x7f10780a2750 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 1 -- 10.20.193.77:0/2426938122 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068012e50 con 0x7f10780a2750 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f10767fc640 4 set_mon_vals no callback set 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 10 monclient: dump: 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.369 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107e674640 5 monclient: authenticate success, global_id 4259 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107e674640 10 monclient: _renew_subs 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107e674640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107e674640 1 -- 10.20.193.77:0/2426938122 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1078096b50 con 0x7f10780a2750 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107e674640 10 monclient: _renew_subs 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107e674640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107e674640 1 -- 10.20.193.77:0/2426938122 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f107806ff00 con 0x7f10780a2750 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a6c0a89c0 0x7f0a6c1d2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient(hunting): picked mon.noname-a con 0x7f0a6c0a89c0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0a6c0a8da0 0x7f0a6c137420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient: shutdown 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient(hunting): picked mon.noname-b con 0x7f0a6c0a8da0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a6c1388c0 0x7f0a6c13d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient(hunting): picked mon.noname-c con 0x7f0a6c1388c0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c143010 con 0x7f0a6c0a89c0 2026-02-17T12:05:15.370 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 -- 10.20.193.77:0/3866263308 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af409be20 msgr2=0x7f3af4134e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c0a9f20 con 0x7f0a6c0a8da0 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0a6c143190 con 0x7f0a6c1388c0 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a73f23640 10 monclient(hunting): authenticate will time out at 566.994566s 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 --2- 10.20.193.77:0/3866263308 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af409be20 0x7f3af4134e20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40098c0 tx=0x7f3ae401c480 comp rx=0 tx=0).stop 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a6c0a89c0 0x7f0a6c1d2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a6c0a89c0 0x7f0a6c1d2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44494/0 (socket says 10.20.193.77:44494) 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 1 -- 10.20.193.77:0/1683476052 learned_addr learned my addr 10.20.193.77:0/1683476052 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 10 monclient(hunting): get_auth_request con 0x7f0a6c0a89c0 auth_method 0 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71497640 1 --2- 10.20.193.77:0/1683476052 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0a6c0a8da0 0x7f0a6c137420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71497640 10 monclient(hunting): get_auth_request con 0x7f0a6c0a8da0 auth_method 0 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71497640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71497640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.371 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71497640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a72499640 1 --2- 10.20.193.77:0/1683476052 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a6c1388c0 0x7f0a6c13d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a72499640 10 monclient(hunting): get_auth_request con 0x7f0a6c1388c0 auth_method 0 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a72499640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a72499640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a72499640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 10 monclient(hunting): handle_auth_done global_id 4278 payload 824 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 -- 10.20.193.77:0/3866263308 shutdown_connections 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 --2- 10.20.193.77:0/3866263308 >> v2:10.20.193.119:3300/0 conn(0x7f3af40a5040 0x7f3af4138800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 1 -- 10.20.193.77:0/1683476052 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a6c1388c0 msgr2=0x7f0a6c13d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 1 --2- 10.20.193.77:0/1683476052 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a6c1388c0 0x7f0a6c13d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 --2- 10.20.193.77:0/3866263308 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af409be20 0x7f3af4134e20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 -- 10.20.193.77:0/3866263308 >> 10.20.193.77:0/3866263308 conn(0x7f3af4074ba0 msgr2=0x7f3af40aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 1 -- 10.20.193.77:0/1683476052 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0a6c0a8da0 msgr2=0x7f0a6c137420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 1 --2- 10.20.193.77:0/1683476052 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0a6c0a8da0 0x7f0a6c137420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 1 monclient: found mon.noname-a 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f0a71c98640 1 -- 10.20.193.77:0/1683476052 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6c1217f0 con 0x7f0a6c0a89c0 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 1 -- 10.20.193.77:0/2426938122 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f106801b400 con 0x7f10780a2750 2026-02-17T12:05:15.372 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 -- 10.20.193.77:0/3866263308 shutdown_connections 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 -- 10.20.193.77:0/3866263308 wait complete. 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107e674640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107e674640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107e674640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f107e674640 1 -- 10.20.193.77:0/2426938122 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10780a2210 con 0x7f10780a2750 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 1 --2- 10.20.193.77:0/2426938122 >> v2:10.20.193.119:6800/4127986552 conn(0x7f104803a310 0x7f104803c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1074ff9640 1 -- 10.20.193.77:0/2426938122 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f106804dd10 con 0x7f10780a2750 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient: build_initial_monmap 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient: monmap: 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1077fff640 1 --2- 10.20.193.77:0/2426938122 >> v2:10.20.193.119:6800/4127986552 conn(0x7f104803a310 0x7f104803c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.373 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f1077fff640 10 monclient: get_auth_request con 0x7f104803a310 auth_method 0 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 Processor -- start 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 -- start start 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient: init 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f3af409be20 0x7f3af41d2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient(hunting): picked mon.noname-a con 0x7f3af409be20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af40a4c20 0x7f3af41d2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient(hunting): picked mon.noname-c con 0x7f3af40a4c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3af40a5040 0x7f3af41d2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient(hunting): picked mon.noname-b con 0x7f3af40a5040 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3af4138f50 con 0x7f3af409be20 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3af4142ec0 con 0x7f3af40a5040 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3af4143040 con 0x7f3af40a4c20 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3afb9ce640 10 monclient(hunting): authenticate will time out at 566.995768s 2026-02-17T12:05:15.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f54d6575640 1 --2- 10.20.193.77:0/1777797534 >> v2:10.20.193.119:6800/4127986552 conn(0x7f54a403a170 0x7f54a403c630 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0ab000 tx=0x7f54cc004840 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af8f42640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af40a4c20 0x7f3af41d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af8f42640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af40a4c20 0x7f3af41d2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50802/0 (socket says 10.20.193.77:50802) 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af8f42640 1 -- 10.20.193.77:0/950239682 learned_addr learned my addr 10.20.193.77:0/950239682 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af8f42640 10 monclient(hunting): get_auth_request con 0x7f3af40a4c20 auth_method 0 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af8f42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af8f42640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af8f42640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af8f42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af8f42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af8f42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af9f44640 1 --2- 10.20.193.77:0/950239682 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3af40a5040 0x7f3af41d2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af9f44640 10 monclient(hunting): get_auth_request con 0x7f3af40a5040 auth_method 0 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af9f44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af9f44640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af9f44640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.315+0000 7f3af8f42640 10 monclient(hunting): handle_auth_done global_id 4265 payload 824 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3af8f42640 1 -- 10.20.193.77:0/950239682 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3af40a5040 msgr2=0x7f3af41d2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3af8f42640 1 --2- 10.20.193.77:0/950239682 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3af40a5040 0x7f3af41d2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3af8f42640 1 -- 10.20.193.77:0/950239682 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f3af409be20 msgr2=0x7f3af41d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3af8f42640 1 --2- 10.20.193.77:0/950239682 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f3af409be20 0x7f3af41d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3af8f42640 10 monclient: _finish_hunting 0 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3af8f42640 1 monclient: found mon.noname-c 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3af8f42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3af8f42640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3af8f42640 1 -- 10.20.193.77:0/950239682 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af40a37c0 con 0x7f3af40a4c20 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a71c98640 1 -- 10.20.193.77:0/1683476052 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a6c0a89c0 msgr2=0x7f0a6c1d2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a71c98640 1 --2- 10.20.193.77:0/1683476052 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a6c0a89c0 0x7f0a6c1d2270 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00c7a0 tx=0x7f0a5c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 1 -- 10.20.193.77:0/1683476052 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c015070 con 0x7f0a6c0a89c0 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 10 monclient: dump: 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 1 -- 10.20.193.77:0/1683476052 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a5c00ac70 con 0x7f0a6c0a89c0 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 1 -- 10.20.193.77:0/1683476052 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c011630 con 0x7f0a6c0a89c0 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 10 monclient: dump: 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5bfff640 4 set_mon_vals no callback set 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a73f23640 5 monclient: authenticate success, global_id 4278 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a73f23640 10 monclient: _renew_subs 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a73f23640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a73f23640 1 -- 10.20.193.77:0/1683476052 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6c13f760 con 0x7f0a6c0a89c0 2026-02-17T12:05:15.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a73f23640 10 monclient: _renew_subs 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a73f23640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a73f23640 1 -- 10.20.193.77:0/1683476052 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a6c121510 con 0x7f0a6c0a89c0 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f1074ff9640 1 -- 10.20.193.77:0/2426938122 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f1068020020 con 0x7f10780a2750 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f1074ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f1074ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a73f23640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a73f23640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a73f23640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a73f23640 1 -- 10.20.193.77:0/1683476052 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a6c138380 con 0x7f0a6c0a89c0 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 1 -- 10.20.193.77:0/1683476052 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f0a5c011850 con 0x7f0a6c0a89c0 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 1 --2- 10.20.193.77:0/1683476052 >> v2:10.20.193.119:6800/4127986552 conn(0x7f0a3c03a170 0x7f0a3c03c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a5a7fc640 1 -- 10.20.193.77:0/1683476052 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f0a5c04de50 con 0x7f0a6c0a89c0 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f1077fff640 1 --2- 10.20.193.77:0/2426938122 >> v2:10.20.193.119:6800/4127986552 conn(0x7f104803a310 0x7f104803c7d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1064004000 tx=0x7f1064004840 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3af8f42640 1 -- 10.20.193.77:0/950239682 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af40a4c20 msgr2=0x7f3af41d2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3af8f42640 1 --2- 10.20.193.77:0/950239682 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af40a4c20 0x7f3af41d2850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800c5a0 tx=0x7f3ae800ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3af8f42640 1 --2- 10.20.193.77:0/950239682 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af40a4c20 0x7f3af41d2850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800c5a0 tx=0x7f3ae800ca60 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f3ae8017070 mon_map magic: 0 2026-02-17T12:05:15.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a71497640 1 --2- 10.20.193.77:0/1683476052 >> v2:10.20.193.119:6800/4127986552 conn(0x7f0a3c03a170 0x7f0a3c03c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 1 -- 10.20.193.77:0/950239682 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8017070 con 0x7f3af40a4c20 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 10 monclient: dump: 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f0a71497640 10 monclient: get_auth_request con 0x7f0a3c03a170 auth_method 0 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 1 -- 10.20.193.77:0/950239682 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae8007070 con 0x7f3af40a4c20 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3afb9ce640 5 monclient: authenticate success, global_id 4265 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3afb9ce640 10 monclient: _renew_subs 2026-02-17T12:05:15.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3afb9ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3afb9ce640 1 -- 10.20.193.77:0/950239682 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af40a8a60 con 0x7f3af40a4c20 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae37fe640 4 set_mon_vals no callback set 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3afb9ce640 10 monclient: _renew_subs 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3afb9ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3afb9ce640 1 -- 10.20.193.77:0/950239682 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af40a1c10 con 0x7f3af40a4c20 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3afb9ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3afb9ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3afb9ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3afb9ce640 1 -- 10.20.193.77:0/950239682 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af4134e00 con 0x7f3af40a4c20 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 1 -- 10.20.193.77:0/950239682 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8007460 con 0x7f3af40a4c20 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 10 monclient: dump: 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 1 -- 10.20.193.77:0/950239682 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f3ae8007600 con 0x7f3af40a4c20 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.319+0000 7f3ae1ffb640 1 --2- 10.20.193.77:0/950239682 >> v2:10.20.193.119:6800/4127986552 conn(0x7f3ac403a120 0x7f3ac403c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.323+0000 7f0a71497640 1 --2- 10.20.193.77:0/1683476052 >> v2:10.20.193.119:6800/4127986552 conn(0x7f0a3c03a170 0x7f0a3c03c630 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a60004000 tx=0x7f0a600a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.323+0000 7f3af9743640 1 --2- 10.20.193.77:0/950239682 >> v2:10.20.193.119:6800/4127986552 conn(0x7f3ac403a120 0x7f3ac403c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.323+0000 7f3af9743640 10 monclient: get_auth_request con 0x7f3ac403a120 auth_method 0 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.323+0000 7f0a5a7fc640 1 -- 10.20.193.77:0/1683476052 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f0a5c011b70 con 0x7f0a6c0a89c0 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.323+0000 7f0a5a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.323+0000 7f0a5a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:15.380 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.323+0000 7f3ae1ffb640 1 -- 10.20.193.77:0/950239682 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f3ae804d8c0 con 0x7f3af40a4c20 2026-02-17T12:05:15.380 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.323+0000 7f3af9743640 1 --2- 10.20.193.77:0/950239682 >> v2:10.20.193.119:6800/4127986552 conn(0x7f3ac403a120 0x7f3ac403c5e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40ab000 tx=0x7f3ae4004840 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:15.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T12:05:15.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T12:05:15.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 1 -- 10.20.193.77:0/447417485 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f40f013fcb0 con 0x7f40f009be20 2026-02-17T12:05:15.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40de7fc640 1 -- 10.20.193.77:0/447417485 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f40e0019300 con 0x7f40f009be20 2026-02-17T12:05:15.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40de7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T12:05:15.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40de7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:15.392 INFO:teuthology.orchestra.run.trial077.stdout:55834574851 2026-02-17T12:05:15.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 1 -- 10.20.193.77:0/447417485 >> v2:10.20.193.119:6800/4127986552 conn(0x7f40c003a170 msgr2=0x7f40c003c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 1 --2- 10.20.193.77:0/447417485 >> v2:10.20.193.119:6800/4127986552 conn(0x7f40c003a170 0x7f40c003c630 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f40f00750e0 tx=0x7f40e4008040 comp rx=0 tx=0).stop 2026-02-17T12:05:15.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 10 monclient: shutdown 2026-02-17T12:05:15.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 1 -- 10.20.193.77:0/447417485 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f009be20 msgr2=0x7f40f01d2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 1 --2- 10.20.193.77:0/447417485 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f009be20 0x7f40f01d2480 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f40e000c570 tx=0x7f40e000ca30 comp rx=0 tx=0).stop 2026-02-17T12:05:15.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 1 -- 10.20.193.77:0/447417485 shutdown_connections 2026-02-17T12:05:15.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 1 --2- 10.20.193.77:0/447417485 >> v2:10.20.193.119:6800/4127986552 conn(0x7f40c003a170 0x7f40c003c630 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 1 --2- 10.20.193.77:0/447417485 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f40f00a5040 0x7f40f013e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 1 --2- 10.20.193.77:0/447417485 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f40f00a4c20 0x7f40f01d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 1 --2- 10.20.193.77:0/447417485 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f40f009be20 0x7f40f01d2480 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 1 -- 10.20.193.77:0/447417485 >> 10.20.193.77:0/447417485 conn(0x7f40f0074ba0 msgr2=0x7f40f0137d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 1 -- 10.20.193.77:0/447417485 shutdown_connections 2026-02-17T12:05:15.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.391+0000 7f40f7e77640 1 -- 10.20.193.77:0/447417485 wait complete. 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 1 -- 10.20.193.77:0/1777797534 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f54d8069040 con 0x7f54d8136050 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54beffd640 1 -- 10.20.193.77:0/1777797534 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f54c8005e20 con 0x7f54d8136050 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54beffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54beffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stdout:51539607554 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 1 -- 10.20.193.77:0/1777797534 >> v2:10.20.193.119:6800/4127986552 conn(0x7f54a403a170 msgr2=0x7f54a403c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 1 --2- 10.20.193.77:0/1777797534 >> v2:10.20.193.119:6800/4127986552 conn(0x7f54a403a170 0x7f54a403c630 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0ab000 tx=0x7f54cc004840 comp rx=0 tx=0).stop 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 10 monclient: shutdown 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 1 -- 10.20.193.77:0/1777797534 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f54d8136050 msgr2=0x7f54d813b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 1 --2- 10.20.193.77:0/1777797534 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f54d8136050 0x7f54d813b370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f54c8009e50 tx=0x7f54c800c490 comp rx=0 tx=0).stop 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 1 -- 10.20.193.77:0/1777797534 shutdown_connections 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 1 --2- 10.20.193.77:0/1777797534 >> v2:10.20.193.119:6800/4127986552 conn(0x7f54a403a170 0x7f54a403c630 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 1 --2- 10.20.193.77:0/1777797534 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f54d8136050 0x7f54d813b370 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 1 --2- 10.20.193.77:0/1777797534 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f54d80a3670 0x7f54d8135350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 1 --2- 10.20.193.77:0/1777797534 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f54d80a3290 0x7f54d81d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 1 -- 10.20.193.77:0/1777797534 >> 10.20.193.77:0/1777797534 conn(0x7f54d80a8a60 msgr2=0x7f54d80a7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 1 -- 10.20.193.77:0/1777797534 shutdown_connections 2026-02-17T12:05:15.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f54dc8cb640 1 -- 10.20.193.77:0/1777797534 wait complete. 2026-02-17T12:05:15.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f6397c35640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T12:05:15.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f6397c35640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T12:05:15.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f6397c35640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f6397c35640 1 -- 10.20.193.77:0/2137636484 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6390138370 con 0x7f63900a3290 2026-02-17T12:05:15.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.395+0000 7f63959aa640 1 --2- 10.20.193.77:0/2137636484 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f63900a3290 0x7f63901378f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f638001abf0 tx=0x7f63800192e0 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f63800041e0 mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) 2026-02-17T12:05:15.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T12:05:15.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T12:05:15.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:15.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 1 -- 10.20.193.77:0/2426938122 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f107806d670 con 0x7f10780a2750 2026-02-17T12:05:15.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f1074ff9640 1 -- 10.20.193.77:0/2426938122 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f106804cbd0 con 0x7f10780a2750 2026-02-17T12:05:15.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f1074ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T12:05:15.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f1074ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:15.400 INFO:teuthology.orchestra.run.trial077.stdout:51539607554 2026-02-17T12:05:15.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 1 -- 10.20.193.77:0/2426938122 >> v2:10.20.193.119:6800/4127986552 conn(0x7f104803a310 msgr2=0x7f104803c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 1 --2- 10.20.193.77:0/2426938122 >> v2:10.20.193.119:6800/4127986552 conn(0x7f104803a310 0x7f104803c7d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1064004000 tx=0x7f1064004840 comp rx=0 tx=0).stop 2026-02-17T12:05:15.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 10 monclient: shutdown 2026-02-17T12:05:15.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 1 -- 10.20.193.77:0/2426938122 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a2750 msgr2=0x7f1078092f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 1 --2- 10.20.193.77:0/2426938122 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a2750 0x7f1078092f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f106800c580 tx=0x7f106800ca40 comp rx=0 tx=0).stop 2026-02-17T12:05:15.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 1 -- 10.20.193.77:0/2426938122 shutdown_connections 2026-02-17T12:05:15.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 1 --2- 10.20.193.77:0/2426938122 >> v2:10.20.193.119:6800/4127986552 conn(0x7f104803a310 0x7f104803c7d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 1 --2- 10.20.193.77:0/2426938122 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f10780a2b30 0x7f1078093480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 1 --2- 10.20.193.77:0/2426938122 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f10780a2750 0x7f1078092f40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 1 --2- 10.20.193.77:0/2426938122 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f10780a07d0 0x7f10780996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 1 -- 10.20.193.77:0/2426938122 >> 10.20.193.77:0/2426938122 conn(0x7f10780a73c0 msgr2=0x7f107808d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 1 -- 10.20.193.77:0/2426938122 shutdown_connections 2026-02-17T12:05:15.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.399+0000 7f107e674640 1 -- 10.20.193.77:0/2426938122 wait complete. 2026-02-17T12:05:15.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T12:05:15.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T12:05:15.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:15.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 1 -- 10.20.193.77:0/1683476052 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0a6c069040 con 0x7f0a6c0a89c0 2026-02-17T12:05:15.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a5a7fc640 1 -- 10.20.193.77:0/1683476052 <== mon.0 v2:10.20.193.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0a5c021300 con 0x7f0a6c0a89c0 2026-02-17T12:05:15.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a5a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T12:05:15.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a5a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:15.404 INFO:teuthology.orchestra.run.trial077.stdout:51539607554 2026-02-17T12:05:15.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2026-02-17T12:05:15.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.3 2026-02-17T12:05:15.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 1 -- 10.20.193.77:0/1683476052 >> v2:10.20.193.119:6800/4127986552 conn(0x7f0a3c03a170 msgr2=0x7f0a3c03c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 1 --2- 10.20.193.77:0/1683476052 >> v2:10.20.193.119:6800/4127986552 conn(0x7f0a3c03a170 0x7f0a3c03c630 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a60004000 tx=0x7f0a600a6000 comp rx=0 tx=0).stop 2026-02-17T12:05:15.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 10 monclient: shutdown 2026-02-17T12:05:15.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:15.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 1 -- 10.20.193.77:0/1683476052 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a6c0a89c0 msgr2=0x7f0a6c1d2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:15.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 1 --2- 10.20.193.77:0/1683476052 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a6c0a89c0 0x7f0a6c1d2270 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00c7a0 tx=0x7f0a5c00cc60 comp rx=0 tx=0).stop 2026-02-17T12:05:15.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 1 -- 10.20.193.77:0/1683476052 shutdown_connections 2026-02-17T12:05:15.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 1 --2- 10.20.193.77:0/1683476052 >> v2:10.20.193.119:6800/4127986552 conn(0x7f0a3c03a170 0x7f0a3c03c630 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 1 --2- 10.20.193.77:0/1683476052 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a6c1388c0 0x7f0a6c13d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 1 --2- 10.20.193.77:0/1683476052 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0a6c0a8da0 0x7f0a6c137420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 1 --2- 10.20.193.77:0/1683476052 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a6c0a89c0 0x7f0a6c1d2270 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:15.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 1 -- 10.20.193.77:0/1683476052 >> 10.20.193.77:0/1683476052 conn(0x7f0a6c074c20 msgr2=0x7f0a6c0a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:15.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 1 -- 10.20.193.77:0/1683476052 shutdown_connections 2026-02-17T12:05:15.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.403+0000 7f0a73f23640 1 -- 10.20.193.77:0/1683476052 wait complete. 2026-02-17T12:05:15.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.2 2026-02-17T12:05:15.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.4 2026-02-17T12:05:15.943 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.943+0000 7f3ae1ffb640 1 -- 10.20.193.77:0/950239682 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f3ae8021070 con 0x7f3af40a4c20 2026-02-17T12:05:15.943 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.943+0000 7f3ae1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:15.943 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:15.943+0000 7f3ae1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:16.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.019+0000 7f3afb9ce640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T12:05:16.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.019+0000 7f3afb9ce640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T12:05:16.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.019+0000 7f3afb9ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.019+0000 7f3afb9ce640 1 -- 10.20.193.77:0/950239682 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3af40a1e90 con 0x7f3af40a4c20 2026-02-17T12:05:16.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.019+0000 7f3ae1ffb640 1 -- 10.20.193.77:0/950239682 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ae804b7d0 con 0x7f3af40a4c20 2026-02-17T12:05:16.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.019+0000 7f3ae1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T12:05:16.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.019+0000 7f3ae1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:16.022 INFO:teuthology.orchestra.run.trial077.stdout:47244640259 2026-02-17T12:05:16.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.023+0000 7f3afb9ce640 1 -- 10.20.193.77:0/950239682 >> v2:10.20.193.119:6800/4127986552 conn(0x7f3ac403a120 msgr2=0x7f3ac403c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.023+0000 7f3afb9ce640 1 --2- 10.20.193.77:0/950239682 >> v2:10.20.193.119:6800/4127986552 conn(0x7f3ac403a120 0x7f3ac403c5e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40ab000 tx=0x7f3ae4004840 comp rx=0 tx=0).stop 2026-02-17T12:05:16.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.023+0000 7f3afb9ce640 10 monclient: shutdown 2026-02-17T12:05:16.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.023+0000 7f3afb9ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:16.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.023+0000 7f3afb9ce640 1 -- 10.20.193.77:0/950239682 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af40a4c20 msgr2=0x7f3af41d2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.023+0000 7f3afb9ce640 1 --2- 10.20.193.77:0/950239682 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af40a4c20 0x7f3af41d2850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800c5a0 tx=0x7f3ae800ca60 comp rx=0 tx=0).stop 2026-02-17T12:05:16.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.023+0000 7f3afb9ce640 1 -- 10.20.193.77:0/950239682 shutdown_connections 2026-02-17T12:05:16.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.023+0000 7f3afb9ce640 1 --2- 10.20.193.77:0/950239682 >> v2:10.20.193.119:6800/4127986552 conn(0x7f3ac403a120 0x7f3ac403c5e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.023+0000 7f3afb9ce640 1 --2- 10.20.193.77:0/950239682 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f3af40a5040 0x7f3af41d2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.023+0000 7f3afb9ce640 1 --2- 10.20.193.77:0/950239682 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f3af40a4c20 0x7f3af41d2850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.023+0000 7f3afb9ce640 1 --2- 10.20.193.77:0/950239682 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f3af409be20 0x7f3af41d2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.023+0000 7f3afb9ce640 1 -- 10.20.193.77:0/950239682 >> 10.20.193.77:0/950239682 conn(0x7f3af4074ba0 msgr2=0x7f3af4132a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:16.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.023+0000 7f3afb9ce640 1 -- 10.20.193.77:0/950239682 shutdown_connections 2026-02-17T12:05:16.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.023+0000 7f3afb9ce640 1 -- 10.20.193.77:0/950239682 wait complete. 2026-02-17T12:05:16.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.0 2026-02-17T12:05:16.224 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f637e7fc640 1 -- 10.20.193.77:0/2137636484 <== mon.0 v2:10.20.193.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f63800041e0 con 0x7f63900a3290 2026-02-17T12:05:16.224 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f637e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T12:05:16.224 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f637e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:16.225 INFO:teuthology.orchestra.run.trial077.stdout:51539607554 2026-02-17T12:05:16.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f6397c35640 1 -- 10.20.193.77:0/2137636484 >> v2:10.20.193.119:6800/4127986552 conn(0x7f636003a1a0 msgr2=0x7f636003c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f6397c35640 1 --2- 10.20.193.77:0/2137636484 >> v2:10.20.193.119:6800/4127986552 conn(0x7f636003a1a0 0x7f636003c660 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6384007fd0 tx=0x7f6384007ac0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f6397c35640 10 monclient: shutdown 2026-02-17T12:05:16.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f6397c35640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:16.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f6397c35640 1 -- 10.20.193.77:0/2137636484 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f63900a3290 msgr2=0x7f63901378f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f6397c35640 1 --2- 10.20.193.77:0/2137636484 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f63900a3290 0x7f63901378f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f638001abf0 tx=0x7f63800192e0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f6397c35640 1 -- 10.20.193.77:0/2137636484 shutdown_connections 2026-02-17T12:05:16.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f6397c35640 1 --2- 10.20.193.77:0/2137636484 >> v2:10.20.193.119:6800/4127986552 conn(0x7f636003a1a0 0x7f636003c660 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f6397c35640 1 --2- 10.20.193.77:0/2137636484 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6390138f70 0x7f63901d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f6397c35640 1 --2- 10.20.193.77:0/2137636484 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6390138b60 0x7f6390137e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f6397c35640 1 --2- 10.20.193.77:0/2137636484 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f63900a3290 0x7f63901378f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f6397c35640 1 -- 10.20.193.77:0/2137636484 >> 10.20.193.77:0/2137636484 conn(0x7f63900a8a60 msgr2=0x7f63900a1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:16.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f6397c35640 1 -- 10.20.193.77:0/2137636484 shutdown_connections 2026-02-17T12:05:16.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.223+0000 7f6397c35640 1 -- 10.20.193.77:0/2137636484 wait complete. 2026-02-17T12:05:16.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.1 2026-02-17T12:05:16.405 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T12:05:16.406 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T12:05:16.413 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T12:05:16.417 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T12:05:16.466 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 10 monclient: get_monmap_and_config 2026-02-17T12:05:16.467 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 10 monclient: build_initial_monmap 2026-02-17T12:05:16.467 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 10 monclient: monmap: 2026-02-17T12:05:16.467 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:16.467 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.467 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:16.469338+0000 2026-02-17T12:05:16.467 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:16.469338+0000 2026-02-17T12:05:16.467 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:16.467 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.467 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:16.468 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:16.468 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:16.468 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:16.468 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:16.468 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.469 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 1 Processor -- start 2026-02-17T12:05:16.469 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 1 -- start start 2026-02-17T12:05:16.469 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 10 monclient: init 2026-02-17T12:05:16.469 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 10 monclient: get_monmap_and_config 2026-02-17T12:05:16.469 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 10 monclient: build_initial_monmap 2026-02-17T12:05:16.470 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 10 monclient: monmap: 2026-02-17T12:05:16.470 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:16.470 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.470 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:16.470013+0000 2026-02-17T12:05:16.470 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:16.470013+0000 2026-02-17T12:05:16.470 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:16.470 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.470 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:16.470 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:16.470 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:16.470 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:16.471 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:16.471 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:16.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 10 monclient: _add_conns ranks=[1,0,2,4,3] 2026-02-17T12:05:16.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5b1009be20 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:16.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5b100a4c20 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:16.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a5070 0x7f5b10140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 10 monclient(hunting): picked mon.noname-b con 0x7f5b100a5070 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:16.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b10135530 con 0x7f5b100a4c20 2026-02-17T12:05:16.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b1009cdf0 con 0x7f5b1009be20 2026-02-17T12:05:16.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1009c200 con 0x7f5b100a5070 2026-02-17T12:05:16.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:16.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b15f73640 10 monclient(hunting): authenticate will time out at 568.144978s 2026-02-17T12:05:16.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0effd640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f5b100a4c20 0x7f5b1013d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42398/0 (socket says 10.20.193.77:42398) 2026-02-17T12:05:16.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0effd640 1 -- 10.20.193.77:0/1360762473 learned_addr learned my addr 10.20.193.77:0/1360762473 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:16.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 1 --2- 10.20.193.77:0/1360762473 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a5070 0x7f5b10140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 10 monclient(hunting): get_auth_request con 0x7f5b100a5070 auth_method 0 2026-02-17T12:05:16.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:16.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:16.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:16.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 10 monclient(hunting): handle_auth_done global_id 4268 payload 274 2026-02-17T12:05:16.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 1 -- 10.20.193.77:0/1360762473 >> v1:10.20.193.119:6789/0 conn(0x7f5b1009be20 legacy=0x7f5b10134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:16.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 1 -- 10.20.193.77:0/1360762473 >> v1:10.20.193.77:6789/0 conn(0x7f5b100a4c20 legacy=0x7f5b1013d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:16.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:16.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 1 monclient: found mon.noname-b 2026-02-17T12:05:16.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:16.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5b0ffff640 1 -- 10.20.193.77:0/1360762473 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1009d0d0 con 0x7f5b100a5070 2026-02-17T12:05:16.478 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 1 Processor -- start 2026-02-17T12:05:16.478 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 1 -- start start 2026-02-17T12:05:16.478 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 10 monclient: init 2026-02-17T12:05:16.478 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:16.478 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 10 monclient: _add_conns ranks=[1,2,4,0,3] 2026-02-17T12:05:16.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5d0809be20 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:16.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a4c20 0x7f5d0813d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 10 monclient(hunting): picked mon.noname-b con 0x7f5d080a4c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:16.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f5d080a5040 0x7f5d0813f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 10 monclient(hunting): picked mon.noname-c con 0x7f5d080a5040 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:16.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d08135530 con 0x7f5d0809be20 2026-02-17T12:05:16.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f5d0809c200 con 0x7f5d080a5040 2026-02-17T12:05:16.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d0809cdf0 con 0x7f5d080a4c20 2026-02-17T12:05:16.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:16.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d0d77a640 10 monclient(hunting): authenticate will time out at 568.145880s 2026-02-17T12:05:16.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a4c20 0x7f5d0813d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a4c20 0x7f5d0813d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50814/0 (socket says 10.20.193.77:50814) 2026-02-17T12:05:16.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 1 -- 10.20.193.77:0/2554937280 learned_addr learned my addr 10.20.193.77:0/2554937280 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:16.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 10 monclient(hunting): get_auth_request con 0x7f5d080a4c20 auth_method 0 2026-02-17T12:05:16.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:16.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:16.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d077fe640 1 --2- 10.20.193.77:0/2554937280 >> v2:10.20.193.119:3300/0 conn(0x7f5d080a5040 0x7f5d0813f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:16.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d077fe640 10 monclient(hunting): get_auth_request con 0x7f5d080a5040 auth_method 0 2026-02-17T12:05:16.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 10 monclient(hunting): handle_auth_done global_id 4271 payload 274 2026-02-17T12:05:16.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 1 -- 10.20.193.77:0/2554937280 >> v2:10.20.193.119:3300/0 conn(0x7f5d080a5040 msgr2=0x7f5d0813f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:16.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 1 --2- 10.20.193.77:0/2554937280 >> v2:10.20.193.119:3300/0 conn(0x7f5d080a5040 0x7f5d0813f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 1 -- 10.20.193.77:0/2554937280 >> v1:10.20.193.119:6789/0 conn(0x7f5d0809be20 legacy=0x7f5d08134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:16.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 10 monclient: _finish_hunting 0 2026-02-17T12:05:16.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 1 monclient: found mon.noname-b 2026-02-17T12:05:16.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:16.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.467+0000 7f5d067fc640 1 -- 10.20.193.77:0/2554937280 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0809d0d0 con 0x7f5d080a4c20 2026-02-17T12:05:16.483 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0ffff640 1 -- 10.20.193.77:0/1360762473 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a5070 msgr2=0x7f5b10140ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:16.483 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0ffff640 1 --2- 10.20.193.77:0/1360762473 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a5070 0x7f5b10140ba0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009dc0 tx=0x7f5b0401c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b1a0cdd4a1e84fc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:16.483 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0e7fc640 1 -- 10.20.193.77:0/1360762473 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b040b2070 con 0x7f5b100a5070 2026-02-17T12:05:16.483 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.483 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:16.483 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0e7fc640 10 monclient: dump: 2026-02-17T12:05:16.483 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.483 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.483 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.483 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.483 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.484 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.484 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.484 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.484 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.484 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0e7fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:16.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0e7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:16.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:16.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0e7fc640 1 -- 10.20.193.77:0/1360762473 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b040a5840 con 0x7f5b100a5070 2026-02-17T12:05:16.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 5 monclient: authenticate success, global_id 4268 2026-02-17T12:05:16.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:16.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:16.485 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:16.485 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0e7fc640 1 -- 10.20.193.77:0/1360762473 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b040a5c10 con 0x7f5b100a5070 2026-02-17T12:05:16.485 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 4 set_mon_vals no callback set 2026-02-17T12:05:16.485 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.485 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:16.485 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0e7fc640 10 monclient: dump: 2026-02-17T12:05:16.485 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.485 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.485 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.485 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.485 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.485 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.486 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.486 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.486 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.486 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient: shutdown 2026-02-17T12:05:16.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:16.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 -- 10.20.193.77:0/1360762473 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a5070 msgr2=0x7f5b10140ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 --2- 10.20.193.77:0/1360762473 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a5070 0x7f5b10140ba0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009dc0 tx=0x7f5b0401c810 comp rx=0 tx=0).stop 2026-02-17T12:05:16.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 -- 10.20.193.77:0/1360762473 shutdown_connections 2026-02-17T12:05:16.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 --2- 10.20.193.77:0/1360762473 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a5070 0x7f5b10140ba0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.487 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d067fc640 1 -- 10.20.193.77:0/2554937280 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a4c20 msgr2=0x7f5d0813d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:16.487 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d067fc640 1 --2- 10.20.193.77:0/2554937280 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a4c20 0x7f5d0813d470 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009970 tx=0x7f5cf001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b7e503ed5942f89 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:16.487 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 -- 10.20.193.77:0/1360762473 >> 10.20.193.77:0/1360762473 conn(0x7f5b10074ba0 msgr2=0x7f5b100aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:16.487 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 -- 10.20.193.77:0/1360762473 shutdown_connections 2026-02-17T12:05:16.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 -- 10.20.193.77:0/1360762473 wait complete. 2026-02-17T12:05:16.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d05ffb640 1 -- 10.20.193.77:0/2554937280 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00b1070 con 0x7f5d080a4c20 2026-02-17T12:05:16.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d05ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d05ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:16.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d05ffb640 10 monclient: dump: 2026-02-17T12:05:16.489 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.489 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.489 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.489 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.489 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.489 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.489 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.489 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.489 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.490 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d05ffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:16.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d05ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:16.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d05ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:16.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d05ffb640 1 -- 10.20.193.77:0/2554937280 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf0004230 con 0x7f5d080a4c20 2026-02-17T12:05:16.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d05ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:16.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 5 monclient: authenticate success, global_id 4271 2026-02-17T12:05:16.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d05ffb640 1 -- 10.20.193.77:0/2554937280 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00a8050 con 0x7f5d080a4c20 2026-02-17T12:05:16.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:16.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d05ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 4 set_mon_vals no callback set 2026-02-17T12:05:16.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d05ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:16.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d05ffb640 10 monclient: dump: 2026-02-17T12:05:16.491 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.491 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.491 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.491 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.491 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.491 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.491 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.491 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.491 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.491 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient: shutdown 2026-02-17T12:05:16.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:16.492 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient: build_initial_monmap 2026-02-17T12:05:16.492 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient: monmap: 2026-02-17T12:05:16.492 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:16.492 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:16.492 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:16.492 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:16.492 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:16.492 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.492 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:16.493 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:16.493 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:16.493 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 -- 10.20.193.77:0/2554937280 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a4c20 msgr2=0x7f5d0813d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 --2- 10.20.193.77:0/2554937280 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a4c20 0x7f5d0813d470 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009970 tx=0x7f5cf001c540 comp rx=0 tx=0).stop 2026-02-17T12:05:16.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 -- 10.20.193.77:0/2554937280 shutdown_connections 2026-02-17T12:05:16.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 --2- 10.20.193.77:0/2554937280 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a4c20 0x7f5d0813d470 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 --2- 10.20.193.77:0/2554937280 >> v2:10.20.193.119:3300/0 conn(0x7f5d080a5040 0x7f5d0813f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 -- 10.20.193.77:0/2554937280 >> 10.20.193.77:0/2554937280 conn(0x7f5d08074ba0 msgr2=0x7f5d080aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:16.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 -- 10.20.193.77:0/2554937280 shutdown_connections 2026-02-17T12:05:16.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 -- 10.20.193.77:0/2554937280 wait complete. 2026-02-17T12:05:16.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 Processor -- start 2026-02-17T12:05:16.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 -- start start 2026-02-17T12:05:16.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient: init 2026-02-17T12:05:16.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient: build_initial_monmap 2026-02-17T12:05:16.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient: monmap: 2026-02-17T12:05:16.496 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:16.496 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:16.496 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:16.496 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:16.496 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:16.496 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.496 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:16.497 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:16.497 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:16.497 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.498 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:16.498 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:16.498 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b1009be20 0x7f5b10131810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.498 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient(hunting): picked mon.noname-b con 0x7f5b1009be20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:16.498 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a4c20 0x7f5b10131d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.498 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient(hunting): picked mon.noname-c con 0x7f5b100a4c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:16.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5b100a5070 0x7f5b100a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient(hunting): picked mon.noname-a con 0x7f5b100a5070 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:16.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5b10143c90 con 0x7f5b100a5070 2026-02-17T12:05:16.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5b10143b10 con 0x7f5b1009be20 2026-02-17T12:05:16.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5b10143e10 con 0x7f5b100a4c20 2026-02-17T12:05:16.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:16.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b15f73640 10 monclient(hunting): authenticate will time out at 568.150431s 2026-02-17T12:05:16.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a4c20 0x7f5b10131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0ffff640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5b100a5070 0x7f5b100a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a4c20 0x7f5b10131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50818/0 (socket says 10.20.193.77:50818) 2026-02-17T12:05:16.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 1 -- 10.20.193.77:0/614227539 learned_addr learned my addr 10.20.193.77:0/614227539 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:16.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 10 monclient(hunting): get_auth_request con 0x7f5b100a4c20 auth_method 0 2026-02-17T12:05:16.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 Processor -- start 2026-02-17T12:05:16.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0ffff640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5b100a5070 0x7f5b100a27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44510/0 (socket says 10.20.193.77:44510) 2026-02-17T12:05:16.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0ffff640 10 monclient(hunting): get_auth_request con 0x7f5b100a5070 auth_method 0 2026-02-17T12:05:16.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:16.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:16.502 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:16.502 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 -- start start 2026-02-17T12:05:16.502 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient: init 2026-02-17T12:05:16.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:16.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:16.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:16.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0f7fe640 1 --2- 10.20.193.77:0/614227539 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b1009be20 0x7f5b10131810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0f7fe640 10 monclient(hunting): get_auth_request con 0x7f5b1009be20 auth_method 0 2026-02-17T12:05:16.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 10 monclient(hunting): handle_auth_done global_id 4274 payload 824 2026-02-17T12:05:16.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 1 -- 10.20.193.77:0/614227539 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b1009be20 msgr2=0x7f5b10131810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 1 --2- 10.20.193.77:0/614227539 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b1009be20 0x7f5b10131810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 1 -- 10.20.193.77:0/614227539 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5b100a5070 msgr2=0x7f5b100a27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 1 --2- 10.20.193.77:0/614227539 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5b100a5070 0x7f5b100a27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 10 monclient: _finish_hunting 0 2026-02-17T12:05:16.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 1 monclient: found mon.noname-c 2026-02-17T12:05:16.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:16.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5b0effd640 1 -- 10.20.193.77:0/614227539 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b100a8b80 con 0x7f5b100a4c20 2026-02-17T12:05:16.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:16.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:05:16.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5d0809be20 0x7f5d080a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient(hunting): picked mon.noname-b con 0x7f5d0809be20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:16.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5d080a4c20 0x7f5d080a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient(hunting): picked mon.noname-a con 0x7f5d080a4c20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:16.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a5040 0x7f5d0813dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient(hunting): picked mon.noname-c con 0x7f5d080a5040 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08142ab0 con 0x7f5d080a4c20 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08142930 con 0x7f5d0809be20 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d08142c30 con 0x7f5d080a5040 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d0d77a640 10 monclient(hunting): authenticate will time out at 568.150891s 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a5040 0x7f5d0813dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a5040 0x7f5d0813dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50824/0 (socket says 10.20.193.77:50824) 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d067fc640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5d080a4c20 0x7f5d080a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 1 -- 10.20.193.77:0/776159428 learned_addr learned my addr 10.20.193.77:0/776159428 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 10 monclient(hunting): get_auth_request con 0x7f5d080a5040 auth_method 0 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d067fc640 10 monclient(hunting): get_auth_request con 0x7f5d080a4c20 auth_method 0 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d067fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d067fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d067fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d067fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d06ffd640 1 --2- 10.20.193.77:0/776159428 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5d0809be20 0x7f5d080a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d06ffd640 10 monclient(hunting): get_auth_request con 0x7f5d0809be20 auth_method 0 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d06ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d06ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 10 monclient(hunting): handle_auth_done global_id 4277 payload 824 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 1 -- 10.20.193.77:0/776159428 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5d0809be20 msgr2=0x7f5d080a4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 1 --2- 10.20.193.77:0/776159428 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5d0809be20 0x7f5d080a4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 1 -- 10.20.193.77:0/776159428 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5d080a4c20 msgr2=0x7f5d080a45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 1 --2- 10.20.193.77:0/776159428 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5d080a4c20 0x7f5d080a45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:16.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 1 monclient: found mon.noname-c 2026-02-17T12:05:16.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:16.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d077fe640 1 -- 10.20.193.77:0/776159428 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0809fb00 con 0x7f5d080a5040 2026-02-17T12:05:16.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.471+0000 7f5d067fc640 1 --2- 10.20.193.77:0/776159428 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5d080a4c20 0x7f5d080a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:16.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b0effd640 1 -- 10.20.193.77:0/614227539 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a4c20 msgr2=0x7f5b10131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:16.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b0effd640 1 --2- 10.20.193.77:0/614227539 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a4c20 0x7f5b10131d50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000c570 tx=0x7f5b0000ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:16.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 1 -- 10.20.193.77:0/614227539 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00007070 con 0x7f5b100a4c20 2026-02-17T12:05:16.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:16.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 10 monclient: dump: 2026-02-17T12:05:16.510 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.510 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.510 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.510 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.510 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.510 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.510 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.510 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.511 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.511 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 10 monclient: _finish_auth 0 2026-02-17T12:05:16.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:16.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:16.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 1 -- 10.20.193.77:0/614227539 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b00007210 con 0x7f5b100a4c20 2026-02-17T12:05:16.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:16.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 1 -- 10.20.193.77:0/614227539 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00007600 con 0x7f5b100a4c20 2026-02-17T12:05:16.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:16.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 10 monclient: dump: 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b0dffb640 4 set_mon_vals no callback set 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b15f73640 5 monclient: authenticate success, global_id 4274 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b15f73640 10 monclient: _renew_subs 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b15f73640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b15f73640 1 -- 10.20.193.77:0/614227539 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b101395f0 con 0x7f5b100a4c20 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b15f73640 10 monclient: _renew_subs 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b15f73640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b15f73640 1 -- 10.20.193.77:0/614227539 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b10132290 con 0x7f5b100a4c20 2026-02-17T12:05:16.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d077fe640 1 -- 10.20.193.77:0/776159428 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a5040 msgr2=0x7f5d0813dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:16.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d077fe640 1 --2- 10.20.193.77:0/776159428 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a5040 0x7f5d0813dee0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8007e40 tx=0x7f5cf800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:16.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b15f73640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:16.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b15f73640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:16.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b15f73640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b15f73640 1 -- 10.20.193.77:0/614227539 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b100a90b0 con 0x7f5b100a4c20 2026-02-17T12:05:16.514 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 1 -- 10.20.193.77:0/776159428 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8013790 con 0x7f5d080a5040 2026-02-17T12:05:16.514 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.514 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:16.514 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 10 monclient: dump: 2026-02-17T12:05:16.514 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.514 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.514 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.514 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 1 -- 10.20.193.77:0/776159428 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf8019070 con 0x7f5d080a5040 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 1 -- 10.20.193.77:0/776159428 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8013b90 con 0x7f5d080a5040 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d057fa640 4 set_mon_vals no callback set 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 10 monclient: dump: 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.515 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d0d77a640 5 monclient: authenticate success, global_id 4277 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d0d77a640 10 monclient: _renew_subs 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d0d77a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d0d77a640 1 -- 10.20.193.77:0/776159428 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d080a90d0 con 0x7f5d080a5040 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d0d77a640 10 monclient: _renew_subs 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d0d77a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d0d77a640 1 -- 10.20.193.77:0/776159428 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d0809f820 con 0x7f5d080a5040 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 1 -- 10.20.193.77:0/614227539 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f5b0001b400 con 0x7f5b100a4c20 2026-02-17T12:05:16.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 1 --2- 10.20.193.77:0/614227539 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5ae003a170 0x7f5ae003c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d0d77a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:16.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d0d77a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:16.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d0d77a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5aebfff640 1 -- 10.20.193.77:0/614227539 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f5b0004d6d0 con 0x7f5b100a4c20 2026-02-17T12:05:16.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d0d77a640 1 -- 10.20.193.77:0/776159428 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d0806f590 con 0x7f5d080a5040 2026-02-17T12:05:16.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 1 -- 10.20.193.77:0/776159428 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f5cf801e460 con 0x7f5d080a5040 2026-02-17T12:05:16.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b0f7fe640 1 --2- 10.20.193.77:0/614227539 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5ae003a170 0x7f5ae003c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 1 --2- 10.20.193.77:0/776159428 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5cd403a1a0 0x7f5cd403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5b0f7fe640 10 monclient: get_auth_request con 0x7f5ae003a170 auth_method 0 2026-02-17T12:05:16.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5ce77fe640 1 -- 10.20.193.77:0/776159428 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f5cf804e210 con 0x7f5d080a5040 2026-02-17T12:05:16.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d06ffd640 1 --2- 10.20.193.77:0/776159428 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5cd403a1a0 0x7f5cd403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.475+0000 7f5d06ffd640 10 monclient: get_auth_request con 0x7f5cd403a1a0 auth_method 0 2026-02-17T12:05:16.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.479+0000 7f5aebfff640 1 -- 10.20.193.77:0/614227539 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f5b0001b9b0 con 0x7f5b100a4c20 2026-02-17T12:05:16.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.479+0000 7f5aebfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:16.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.479+0000 7f5aebfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:16.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.479+0000 7f5b0f7fe640 1 --2- 10.20.193.77:0/614227539 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5ae003a170 0x7f5ae003c630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5afc005030 tx=0x7f5afc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:16.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.479+0000 7f5d06ffd640 1 --2- 10.20.193.77:0/776159428 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5cd403a1a0 0x7f5cd403c660 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009990 tx=0x7f5cfc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:16.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.479+0000 7f5ce77fe640 1 -- 10.20.193.77:0/776159428 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f5cf801ea10 con 0x7f5d080a5040 2026-02-17T12:05:16.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.479+0000 7f5ce77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:16.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.479+0000 7f5ce77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:16.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 10 monclient: get_monmap_and_config 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 10 monclient: build_initial_monmap 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 10 monclient: monmap: 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:16.514003+0000 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:16.514003+0000 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 10 monclient: get_monmap_and_config 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 10 monclient: build_initial_monmap 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 10 monclient: monmap: 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:16.520 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.521 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:16.514233+0000 2026-02-17T12:05:16.521 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:16.514233+0000 2026-02-17T12:05:16.521 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:16.521 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.521 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:16.521 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:16.521 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:16.521 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:16.521 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:16.521 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 1 Processor -- start 2026-02-17T12:05:16.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 1 Processor -- start 2026-02-17T12:05:16.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 1 -- start start 2026-02-17T12:05:16.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 10 monclient: init 2026-02-17T12:05:16.522 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 1 -- start start 2026-02-17T12:05:16.522 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 10 monclient: init 2026-02-17T12:05:16.522 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:16.522 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 10 monclient: _add_conns ranks=[0,4,2,3,1] 2026-02-17T12:05:16.522 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5b6409be20 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:16.522 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f5b640a4b60 0x7f5b640a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.522 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 10 monclient(hunting): picked mon.noname-c con 0x7f5b640a4b60 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:16.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b6413d340 0x7f5b6413f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 10 monclient(hunting): picked mon.noname-b con 0x7f5b6413d340 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:16.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b6409d2f0 con 0x7f5b6409be20 2026-02-17T12:05:16.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f5b6409c480 con 0x7f5b640a4b60 2026-02-17T12:05:16.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5b6409c200 con 0x7f5b6413d340 2026-02-17T12:05:16.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:16.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b6ae79640 10 monclient(hunting): authenticate will time out at 568.189774s 2026-02-17T12:05:16.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:16.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 10 monclient: _add_conns ranks=[2,0,1,3,4] 2026-02-17T12:05:16.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 0x7f8180134e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 10 monclient(hunting): picked mon.noname-b con 0x7f818009be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:16.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b68bee640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f5b6409be20 0x7f5b64134fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42402/0 (socket says 10.20.193.77:42402) 2026-02-17T12:05:16.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f81800a4c20 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:16.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b68bee640 1 -- 10.20.193.77:0/3383207846 learned_addr learned my addr 10.20.193.77:0/3383207846 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:16.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f81800a5040 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:16.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8180138f10 con 0x7f81800a4c20 2026-02-17T12:05:16.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 1 --2- 10.20.193.77:0/3383207846 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b6413d340 0x7f5b6413f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 10 monclient(hunting): get_auth_request con 0x7f5b6413d340 auth_method 0 2026-02-17T12:05:16.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f818009cdf0 con 0x7f81800a5040 2026-02-17T12:05:16.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f818009c200 con 0x7f818009be20 2026-02-17T12:05:16.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:16.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f818482e640 10 monclient(hunting): authenticate will time out at 568.189932s 2026-02-17T12:05:16.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:16.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:16.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:16.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 0x7f8180134e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817dd74640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f81800a4c20 0x7f81801380f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42406/0 (socket says 10.20.193.77:42406) 2026-02-17T12:05:16.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817dd74640 1 -- 10.20.193.77:0/4247426132 learned_addr learned my addr 10.20.193.77:0/4247426132 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:16.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 10 monclient(hunting): get_auth_request con 0x7f818009be20 auth_method 0 2026-02-17T12:05:16.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b5bfff640 1 --2- 10.20.193.77:0/3383207846 >> v2:10.20.193.119:3300/0 conn(0x7f5b640a4b60 0x7f5b640a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 10 monclient(hunting): handle_auth_done global_id 4280 payload 274 2026-02-17T12:05:16.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 1 -- 10.20.193.77:0/3383207846 >> v2:10.20.193.119:3300/0 conn(0x7f5b640a4b60 msgr2=0x7f5b640a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:16.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:16.527 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:16.527 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 1 --2- 10.20.193.77:0/3383207846 >> v2:10.20.193.119:3300/0 conn(0x7f5b640a4b60 0x7f5b640a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.527 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 1 -- 10.20.193.77:0/3383207846 >> v1:10.20.193.77:6789/0 conn(0x7f5b6409be20 legacy=0x7f5b64134fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:16.527 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:16.527 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 10 monclient: _finish_hunting 0 2026-02-17T12:05:16.527 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 1 monclient: found mon.noname-b 2026-02-17T12:05:16.527 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:16.527 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.527 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b693ef640 1 -- 10.20.193.77:0/3383207846 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6409cd30 con 0x7f5b6413d340 2026-02-17T12:05:16.527 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b5bfff640 10 monclient: get_auth_request con 0x7f5b640a4b60 auth_method 0 2026-02-17T12:05:16.527 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f5b5bfff640 1 --2- 10.20.193.77:0/3383207846 >> v2:10.20.193.119:3300/0 conn(0x7f5b640a4b60 0x7f5b640a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:05:16.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 10 monclient(hunting): handle_auth_done global_id 4283 payload 274 2026-02-17T12:05:16.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 1 -- 10.20.193.77:0/4247426132 >> v1:10.20.193.119:6789/0 conn(0x7f81800a5040 legacy=0x7f8180138800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:16.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 1 -- 10.20.193.77:0/4247426132 >> v1:10.20.193.77:6789/0 conn(0x7f81800a4c20 legacy=0x7f81801380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:16.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 10 monclient: _finish_hunting 0 2026-02-17T12:05:16.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 1 monclient: found mon.noname-b 2026-02-17T12:05:16.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:16.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.511+0000 7f817e575640 1 -- 10.20.193.77:0/4247426132 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818009d0d0 con 0x7f818009be20 2026-02-17T12:05:16.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 1 -- 10.20.193.77:0/4247426132 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 msgr2=0x7f8180134e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:16.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 1 --2- 10.20.193.77:0/4247426132 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 0x7f8180134e20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f81740098f0 tx=0x7f817401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84d118b4641793cf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:16.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b693ef640 1 -- 10.20.193.77:0/3383207846 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b6413d340 msgr2=0x7f5b6413f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:16.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b693ef640 1 --2- 10.20.193.77:0/3383207846 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b6413d340 0x7f5b6413f730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009d90 tx=0x7f5b6001c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b309aa52b2f6382f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817d573640 1 -- 10.20.193.77:0/4247426132 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81740b0070 con 0x7f818009be20 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817d573640 10 monclient: dump: 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817d573640 10 monclient: _finish_auth 0 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817d573640 10 monclient: _check_auth_tickets 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817d573640 1 -- 10.20.193.77:0/4247426132 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81740ab600 con 0x7f818009be20 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817d573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817d573640 1 -- 10.20.193.77:0/4247426132 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81740ab9d0 con 0x7f818009be20 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 5 monclient: authenticate success, global_id 4283 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:16.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 4 set_mon_vals no callback set 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817d573640 10 monclient: dump: 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5b7fe640 1 -- 10.20.193.77:0/3383207846 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b600ac070 con 0x7f5b6413d340 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5b7fe640 10 monclient: dump: 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.530 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5b7fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5b7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5b7fe640 1 -- 10.20.193.77:0/3383207846 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b600a6780 con 0x7f5b6413d340 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5b7fe640 1 -- 10.20.193.77:0/3383207846 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b600a6b50 con 0x7f5b6413d340 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 5 monclient: authenticate success, global_id 4280 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 4 set_mon_vals no callback set 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5b7fe640 10 monclient: dump: 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.531 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.532 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient: shutdown 2026-02-17T12:05:16.532 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:16.532 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 -- 10.20.193.77:0/3383207846 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b6413d340 msgr2=0x7f5b6413f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.532 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 --2- 10.20.193.77:0/3383207846 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b6413d340 0x7f5b6413f730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009d90 tx=0x7f5b6001c850 comp rx=0 tx=0).stop 2026-02-17T12:05:16.532 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient: shutdown 2026-02-17T12:05:16.532 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:16.532 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 -- 10.20.193.77:0/4247426132 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 msgr2=0x7f8180134e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.532 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 --2- 10.20.193.77:0/4247426132 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 0x7f8180134e20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f81740098f0 tx=0x7f817401c4c0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.532 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 -- 10.20.193.77:0/3383207846 shutdown_connections 2026-02-17T12:05:16.532 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 --2- 10.20.193.77:0/3383207846 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b6413d340 0x7f5b6413f730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.532 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 --2- 10.20.193.77:0/3383207846 >> v2:10.20.193.119:3300/0 conn(0x7f5b640a4b60 0x7f5b640a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.532 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 -- 10.20.193.77:0/3383207846 >> 10.20.193.77:0/3383207846 conn(0x7f5b64074b90 msgr2=0x7f5b640aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:16.532 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 -- 10.20.193.77:0/3383207846 shutdown_connections 2026-02-17T12:05:16.532 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 -- 10.20.193.77:0/4247426132 shutdown_connections 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 --2- 10.20.193.77:0/4247426132 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 0x7f8180134e20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 -- 10.20.193.77:0/4247426132 >> 10.20.193.77:0/4247426132 conn(0x7f8180074ba0 msgr2=0x7f81800aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 -- 10.20.193.77:0/3383207846 wait complete. 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 -- 10.20.193.77:0/4247426132 shutdown_connections 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 -- 10.20.193.77:0/4247426132 wait complete. 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient: build_initial_monmap 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient: monmap: 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:16.533 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient: build_initial_monmap 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient: monmap: 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 Processor -- start 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 -- start start 2026-02-17T12:05:16.534 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient: init 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 Processor -- start 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 -- start start 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient: init 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b6409be20 0x7f5b640a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient(hunting): picked mon.noname-c con 0x7f5b6409be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5b640a4b60 0x7f5b641d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient(hunting): picked mon.noname-a con 0x7f5b640a4b60 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b6413d340 0x7f5b641d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient(hunting): picked mon.noname-b con 0x7f5b6413d340 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5b64142820 con 0x7f5b640a4b60 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5b641426a0 con 0x7f5b6413d340 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5b641429a0 con 0x7f5b6409be20 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:16.535 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b6ae79640 10 monclient(hunting): authenticate will time out at 568.194935s 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 0x7f81801d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient(hunting): picked mon.noname-c con 0x7f818009be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f81800a4c20 0x7f8180140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient(hunting): picked mon.noname-b con 0x7f81800a4c20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f81800a5040 0x7f81800a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient(hunting): picked mon.noname-a con 0x7f81800a5040 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8180143ed0 con 0x7f81800a5040 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8180144050 con 0x7f81800a4c20 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f81801441d0 con 0x7f818009be20 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:16.536 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f818482e640 10 monclient(hunting): authenticate will time out at 568.194991s 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5b640a4b60 0x7f5b641d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5b640a4b60 0x7f5b641d1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44528/0 (socket says 10.20.193.77:44528) 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 1 -- 10.20.193.77:0/2567347891 learned_addr learned my addr 10.20.193.77:0/2567347891 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 10 monclient(hunting): get_auth_request con 0x7f5b640a4b60 auth_method 0 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b68bee640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b6409be20 0x7f5b640a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817ed76640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f81800a5040 0x7f81800a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 0x7f81801d22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b68bee640 10 monclient(hunting): get_auth_request con 0x7f5b6409be20 auth_method 0 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b68bee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b68bee640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b68bee640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:16.537 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817ed76640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f81800a5040 0x7f81800a2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44538/0 (socket says 10.20.193.77:44538) 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 0x7f81801d22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50860/0 (socket says 10.20.193.77:50860) 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817ed76640 1 -- 10.20.193.77:0/1889310117 learned_addr learned my addr 10.20.193.77:0/1889310117 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817ed76640 10 monclient(hunting): get_auth_request con 0x7f81800a5040 auth_method 0 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b693ef640 1 --2- 10.20.193.77:0/2567347891 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b6413d340 0x7f5b641d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 10 monclient(hunting): get_auth_request con 0x7f818009be20 auth_method 0 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b693ef640 10 monclient(hunting): get_auth_request con 0x7f5b6413d340 auth_method 0 2026-02-17T12:05:16.538 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b693ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.539 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b693ef640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.539 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b693ef640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.539 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b68bee640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:16.539 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b68bee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:16.539 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:16.539 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:16.539 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817dd74640 1 --2- 10.20.193.77:0/1889310117 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f81800a4c20 0x7f8180140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.539 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:16.539 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b68bee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:16.539 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817dd74640 10 monclient(hunting): get_auth_request con 0x7f81800a4c20 auth_method 0 2026-02-17T12:05:16.539 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:16.539 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:16.539 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:16.539 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 10 monclient(hunting): handle_auth_done global_id 4287 payload 824 2026-02-17T12:05:16.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:16.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:16.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:16.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 1 -- 10.20.193.77:0/2567347891 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b6409be20 msgr2=0x7f5b640a41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 1 --2- 10.20.193.77:0/2567347891 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b6409be20 0x7f5b640a41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 1 -- 10.20.193.77:0/2567347891 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b6413d340 msgr2=0x7f5b641d21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 1 --2- 10.20.193.77:0/2567347891 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b6413d340 0x7f5b641d21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:16.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 1 monclient: found mon.noname-a 2026-02-17T12:05:16.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 10 monclient(hunting): handle_auth_done global_id 4289 payload 824 2026-02-17T12:05:16.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 1 -- 10.20.193.77:0/1889310117 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f81800a4c20 msgr2=0x7f8180140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:16.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:16.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f5b5bfff640 1 -- 10.20.193.77:0/2567347891 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b640a1770 con 0x7f5b640a4b60 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 1 --2- 10.20.193.77:0/1889310117 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f81800a4c20 0x7f8180140880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 1 -- 10.20.193.77:0/1889310117 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f81800a5040 msgr2=0x7f81800a2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 1 --2- 10.20.193.77:0/1889310117 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f81800a5040 0x7f81800a2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 10 monclient: _finish_hunting 0 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 1 monclient: found mon.noname-c 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817e575640 1 -- 10.20.193.77:0/1889310117 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818006f590 con 0x7f818009be20 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.515+0000 7f817dd74640 1 --2- 10.20.193.77:0/1889310117 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f81800a4c20 0x7f8180140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b5bfff640 1 -- 10.20.193.77:0/2567347891 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5b640a4b60 msgr2=0x7f5b641d1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b5bfff640 1 --2- 10.20.193.77:0/2567347891 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5b640a4b60 0x7f5b641d1c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00c7d0 tx=0x7f5b4c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f817e575640 1 -- 10.20.193.77:0/1889310117 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 msgr2=0x7f81801d22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f817e575640 1 --2- 10.20.193.77:0/1889310117 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 0x7f81801d22d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f81740ad000 tx=0x7f8174019260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 1 -- 10.20.193.77:0/2567347891 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c015070 con 0x7f5b640a4b60 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:16.541 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 10 monclient: dump: 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 10 monclient: _finish_auth 0 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 10 monclient: _check_auth_tickets 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 1 -- 10.20.193.77:0/2567347891 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b4c00acd0 con 0x7f5b640a4b60 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 1 -- 10.20.193.77:0/2567347891 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c011630 con 0x7f5b640a4b60 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 10 monclient: dump: 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 1 -- 10.20.193.77:0/1889310117 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81740b9070 con 0x7f818009be20 2026-02-17T12:05:16.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b5affd640 4 set_mon_vals no callback set 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b6ae79640 5 monclient: authenticate success, global_id 4287 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b6ae79640 10 monclient: _renew_subs 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b6ae79640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b6ae79640 1 -- 10.20.193.77:0/2567347891 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b64133ea0 con 0x7f5b640a4b60 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 10 monclient: dump: 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 1 -- 10.20.193.77:0/1889310117 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81740b5690 con 0x7f818009be20 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 1 -- 10.20.193.77:0/1889310117 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81740b0040 con 0x7f818009be20 2026-02-17T12:05:16.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 10 monclient: dump: 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f817cd72640 4 set_mon_vals no callback set 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f818482e640 5 monclient: authenticate success, global_id 4289 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f818482e640 10 monclient: _renew_subs 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f818482e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f818482e640 1 -- 10.20.193.77:0/1889310117 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818013ae00 con 0x7f818009be20 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b6ae79640 10 monclient: _renew_subs 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b6ae79640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b6ae79640 1 -- 10.20.193.77:0/2567347891 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b640a22d0 con 0x7f5b640a4b60 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f818482e640 10 monclient: _renew_subs 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f818482e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f818482e640 1 -- 10.20.193.77:0/1889310117 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f81801d2aa0 con 0x7f818009be20 2026-02-17T12:05:16.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b6ae79640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:16.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b6ae79640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:16.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b6ae79640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:16.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b6ae79640 1 -- 10.20.193.77:0/2567347891 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b24005190 con 0x7f5b640a4b60 2026-02-17T12:05:16.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f818482e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:16.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f818482e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:16.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f818482e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f818482e640 1 -- 10.20.193.77:0/1889310117 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8180134e20 con 0x7f818009be20 2026-02-17T12:05:16.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 1 -- 10.20.193.77:0/1889310117 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f81740b5ac0 con 0x7f818009be20 2026-02-17T12:05:16.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 1 -- 10.20.193.77:0/2567347891 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f5b4c0117d0 con 0x7f5b640a4b60 2026-02-17T12:05:16.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 1 --2- 10.20.193.77:0/1889310117 >> v2:10.20.193.119:6800/4127986552 conn(0x7f814c03a170 0x7f814c03c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f8166ffd640 1 -- 10.20.193.77:0/1889310117 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f81740e7c40 con 0x7f818009be20 2026-02-17T12:05:16.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 1 --2- 10.20.193.77:0/2567347891 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5b3403a170 0x7f5b3403c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:16.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f817dd74640 1 --2- 10.20.193.77:0/1889310117 >> v2:10.20.193.119:6800/4127986552 conn(0x7f814c03a170 0x7f814c03c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f817dd74640 10 monclient: get_auth_request con 0x7f814c03a170 auth_method 0 2026-02-17T12:05:16.546 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b597fa640 1 -- 10.20.193.77:0/2567347891 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f5b4c04de50 con 0x7f5b640a4b60 2026-02-17T12:05:16.546 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b68bee640 1 --2- 10.20.193.77:0/2567347891 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5b3403a170 0x7f5b3403c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:16.546 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.519+0000 7f5b68bee640 10 monclient: get_auth_request con 0x7f5b3403a170 auth_method 0 2026-02-17T12:05:16.546 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.523+0000 7f8166ffd640 1 -- 10.20.193.77:0/1889310117 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f81740c3030 con 0x7f818009be20 2026-02-17T12:05:16.546 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.523+0000 7f8166ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:16.546 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.523+0000 7f8166ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:16.546 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.523+0000 7f5b597fa640 1 -- 10.20.193.77:0/2567347891 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f5b4c011af0 con 0x7f5b640a4b60 2026-02-17T12:05:16.546 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.523+0000 7f5b597fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:16.546 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.523+0000 7f5b597fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:16.546 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.523+0000 7f817dd74640 1 --2- 10.20.193.77:0/1889310117 >> v2:10.20.193.119:6800/4127986552 conn(0x7f814c03a170 0x7f814c03c630 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8168007fd0 tx=0x7f8168009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:16.546 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.523+0000 7f5b68bee640 1 --2- 10.20.193.77:0/2567347891 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5b3403a170 0x7f5b3403c630 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b54007da0 tx=0x7f5b54007cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:16.555 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T12:05:16.555 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T12:05:16.555 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.555 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 1 -- 10.20.193.77:0/614227539 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5b10134e00 con 0x7f5b100a4c20 2026-02-17T12:05:16.555 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5aebfff640 1 -- 10.20.193.77:0/614227539 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5b00019300 con 0x7f5b100a4c20 2026-02-17T12:05:16.555 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5aebfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T12:05:16.555 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5aebfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:16.555 INFO:teuthology.orchestra.run.trial077.stdout:55834574852 2026-02-17T12:05:16.556 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 1 -- 10.20.193.77:0/614227539 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5ae003a170 msgr2=0x7f5ae003c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 1 --2- 10.20.193.77:0/614227539 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5ae003a170 0x7f5ae003c630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5afc005030 tx=0x7f5afc009040 comp rx=0 tx=0).stop 2026-02-17T12:05:16.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 10 monclient: shutdown 2026-02-17T12:05:16.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:16.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 1 -- 10.20.193.77:0/614227539 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a4c20 msgr2=0x7f5b10131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 1 --2- 10.20.193.77:0/614227539 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a4c20 0x7f5b10131d50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000c570 tx=0x7f5b0000ca30 comp rx=0 tx=0).stop 2026-02-17T12:05:16.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 1 -- 10.20.193.77:0/614227539 shutdown_connections 2026-02-17T12:05:16.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 1 --2- 10.20.193.77:0/614227539 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5ae003a170 0x7f5ae003c630 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 1 --2- 10.20.193.77:0/614227539 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5b100a5070 0x7f5b100a27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 1 --2- 10.20.193.77:0/614227539 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b100a4c20 0x7f5b10131d50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 1 --2- 10.20.193.77:0/614227539 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b1009be20 0x7f5b10131810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 1 -- 10.20.193.77:0/614227539 >> 10.20.193.77:0/614227539 conn(0x7f5b10074ba0 msgr2=0x7f5b10137d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:16.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 1 -- 10.20.193.77:0/614227539 shutdown_connections 2026-02-17T12:05:16.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.555+0000 7f5b15f73640 1 -- 10.20.193.77:0/614227539 wait complete. 2026-02-17T12:05:16.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T12:05:16.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T12:05:16.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 1 -- 10.20.193.77:0/776159428 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5d08134e00 con 0x7f5d080a5040 2026-02-17T12:05:16.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5ce77fe640 1 -- 10.20.193.77:0/776159428 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5cf801cc40 con 0x7f5d080a5040 2026-02-17T12:05:16.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5ce77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T12:05:16.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5ce77fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:16.561 INFO:teuthology.orchestra.run.trial077.stdout:51539607556 2026-02-17T12:05:16.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 1 -- 10.20.193.77:0/776159428 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5cd403a1a0 msgr2=0x7f5cd403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 1 --2- 10.20.193.77:0/776159428 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5cd403a1a0 0x7f5cd403c660 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009990 tx=0x7f5cfc008040 comp rx=0 tx=0).stop 2026-02-17T12:05:16.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 10 monclient: shutdown 2026-02-17T12:05:16.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:16.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 1 -- 10.20.193.77:0/776159428 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a5040 msgr2=0x7f5d0813dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 1 --2- 10.20.193.77:0/776159428 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a5040 0x7f5d0813dee0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8007e40 tx=0x7f5cf800e4b0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 1 -- 10.20.193.77:0/776159428 shutdown_connections 2026-02-17T12:05:16.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 1 --2- 10.20.193.77:0/776159428 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5cd403a1a0 0x7f5cd403c660 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 1 --2- 10.20.193.77:0/776159428 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5d080a5040 0x7f5d0813dee0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 1 --2- 10.20.193.77:0/776159428 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5d080a4c20 0x7f5d080a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 1 --2- 10.20.193.77:0/776159428 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5d0809be20 0x7f5d080a4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 1 -- 10.20.193.77:0/776159428 >> 10.20.193.77:0/776159428 conn(0x7f5d08074ba0 msgr2=0x7f5d08137cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:16.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 1 -- 10.20.193.77:0/776159428 shutdown_connections 2026-02-17T12:05:16.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.559+0000 7f5d0d77a640 1 -- 10.20.193.77:0/776159428 wait complete. 2026-02-17T12:05:16.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2026-02-17T12:05:16.568 DEBUG:teuthology.parallel:result is None 2026-02-17T12:05:16.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607556 for osd.3 2026-02-17T12:05:16.573 DEBUG:teuthology.parallel:result is None 2026-02-17T12:05:16.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T12:05:16.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T12:05:16.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:16.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 1 -- 10.20.193.77:0/1889310117 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f81800aae80 con 0x7f818009be20 2026-02-17T12:05:16.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f8166ffd640 1 -- 10.20.193.77:0/1889310117 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f818006f590 con 0x7f818009be20 2026-02-17T12:05:16.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f8166ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T12:05:16.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f8166ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:16.600 INFO:teuthology.orchestra.run.trial077.stdout:51539607556 2026-02-17T12:05:16.601 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 1 -- 10.20.193.77:0/1889310117 >> v2:10.20.193.119:6800/4127986552 conn(0x7f814c03a170 msgr2=0x7f814c03c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.601 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 1 --2- 10.20.193.77:0/1889310117 >> v2:10.20.193.119:6800/4127986552 conn(0x7f814c03a170 0x7f814c03c630 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8168007fd0 tx=0x7f8168009040 comp rx=0 tx=0).stop 2026-02-17T12:05:16.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 10 monclient: shutdown 2026-02-17T12:05:16.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:16.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 1 -- 10.20.193.77:0/1889310117 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 msgr2=0x7f81801d22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 1 --2- 10.20.193.77:0/1889310117 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 0x7f81801d22d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f81740ad000 tx=0x7f8174019260 comp rx=0 tx=0).stop 2026-02-17T12:05:16.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 1 -- 10.20.193.77:0/1889310117 shutdown_connections 2026-02-17T12:05:16.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 1 --2- 10.20.193.77:0/1889310117 >> v2:10.20.193.119:6800/4127986552 conn(0x7f814c03a170 0x7f814c03c630 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 1 --2- 10.20.193.77:0/1889310117 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f81800a5040 0x7f81800a2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 1 --2- 10.20.193.77:0/1889310117 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f81800a4c20 0x7f8180140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 1 --2- 10.20.193.77:0/1889310117 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f818009be20 0x7f81801d22d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 1 -- 10.20.193.77:0/1889310117 >> 10.20.193.77:0/1889310117 conn(0x7f8180074ba0 msgr2=0x7f8180137db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:16.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 1 -- 10.20.193.77:0/1889310117 shutdown_connections 2026-02-17T12:05:16.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f818482e640 1 -- 10.20.193.77:0/1889310117 wait complete. 2026-02-17T12:05:16.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f5b6ae79640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T12:05:16.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f5b6ae79640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T12:05:16.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f5b6ae79640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:16.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f5b6ae79640 1 -- 10.20.193.77:0/2567347891 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f5b24005480 con 0x7f5b640a4b60 2026-02-17T12:05:16.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f5b597fa640 1 -- 10.20.193.77:0/2567347891 <== mon.0 v2:10.20.193.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5b4c022c30 con 0x7f5b640a4b60 2026-02-17T12:05:16.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f5b597fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T12:05:16.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.599+0000 7f5b597fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:16.603 INFO:teuthology.orchestra.run.trial077.stdout:51539607556 2026-02-17T12:05:16.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.603+0000 7f5b6ae79640 1 -- 10.20.193.77:0/2567347891 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5b3403a170 msgr2=0x7f5b3403c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.603+0000 7f5b6ae79640 1 --2- 10.20.193.77:0/2567347891 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5b3403a170 0x7f5b3403c630 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b54007da0 tx=0x7f5b54007cf0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.603+0000 7f5b6ae79640 10 monclient: shutdown 2026-02-17T12:05:16.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.603+0000 7f5b6ae79640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:16.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.603+0000 7f5b6ae79640 1 -- 10.20.193.77:0/2567347891 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5b640a4b60 msgr2=0x7f5b641d1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:16.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.603+0000 7f5b6ae79640 1 --2- 10.20.193.77:0/2567347891 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5b640a4b60 0x7f5b641d1c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00c7d0 tx=0x7f5b4c00cc90 comp rx=0 tx=0).stop 2026-02-17T12:05:16.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.603+0000 7f5b6ae79640 1 -- 10.20.193.77:0/2567347891 shutdown_connections 2026-02-17T12:05:16.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.603+0000 7f5b6ae79640 1 --2- 10.20.193.77:0/2567347891 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5b3403a170 0x7f5b3403c630 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.603+0000 7f5b6ae79640 1 --2- 10.20.193.77:0/2567347891 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5b6413d340 0x7f5b641d21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.603+0000 7f5b6ae79640 1 --2- 10.20.193.77:0/2567347891 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5b640a4b60 0x7f5b641d1c60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.603+0000 7f5b6ae79640 1 --2- 10.20.193.77:0/2567347891 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5b6409be20 0x7f5b640a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:16.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.603+0000 7f5b6ae79640 1 -- 10.20.193.77:0/2567347891 >> 10.20.193.77:0/2567347891 conn(0x7f5b64074b90 msgr2=0x7f5b6413e890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:16.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.603+0000 7f5b6ae79640 1 -- 10.20.193.77:0/2567347891 shutdown_connections 2026-02-17T12:05:16.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:16.603+0000 7f5b6ae79640 1 -- 10.20.193.77:0/2567347891 wait complete. 2026-02-17T12:05:16.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607556 for osd.2 2026-02-17T12:05:16.612 DEBUG:teuthology.parallel:result is None 2026-02-17T12:05:16.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607556 for osd.4 2026-02-17T12:05:16.614 DEBUG:teuthology.parallel:result is None 2026-02-17T12:05:17.034 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T12:05:17.105 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 10 monclient: get_monmap_and_config 2026-02-17T12:05:17.106 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 10 monclient: build_initial_monmap 2026-02-17T12:05:17.106 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 10 monclient: monmap: 2026-02-17T12:05:17.106 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:17.106 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.106 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:17.107677+0000 2026-02-17T12:05:17.106 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:17.107677+0000 2026-02-17T12:05:17.106 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:17.106 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.106 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:17.106 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:17.107 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:17.107 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:17.107 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:17.107 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.107 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 1 Processor -- start 2026-02-17T12:05:17.107 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 1 -- start start 2026-02-17T12:05:17.107 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 10 monclient: init 2026-02-17T12:05:17.109 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:17.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 10 monclient: _add_conns ranks=[1,3,4,2,0] 2026-02-17T12:05:17.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc39409c420 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:17.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fc3940a2920 0x7fc39413a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 10 monclient(hunting): picked mon.noname-a con 0x7fc3940a2920 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:17.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fc3940a2d50 0x7fc39413cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 10 monclient(hunting): picked mon.noname-c con 0x7fc3940a2d50 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:17.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc39409ffa0 con 0x7fc39409c420 2026-02-17T12:05:17.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc39409f3e0 con 0x7fc3940a2920 2026-02-17T12:05:17.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fc39409acc0 con 0x7fc3940a2d50 2026-02-17T12:05:17.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:17.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc399703640 10 monclient(hunting): authenticate will time out at 568.783281s 2026-02-17T12:05:17.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fc3940a2920 0x7fc39413a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fc3940a2920 0x7fc39413a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44540/0 (socket says 10.20.193.77:44540) 2026-02-17T12:05:17.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 1 -- 10.20.193.77:0/3536092330 learned_addr learned my addr 10.20.193.77:0/3536092330 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:17.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 10 monclient(hunting): get_auth_request con 0x7fc3940a2920 auth_method 0 2026-02-17T12:05:17.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 10 monclient(hunting): handle_auth_done global_id 4293 payload 274 2026-02-17T12:05:17.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 1 -- 10.20.193.77:0/3536092330 >> v2:10.20.193.119:3300/0 conn(0x7fc3940a2d50 msgr2=0x7fc39413cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:17.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 1 --2- 10.20.193.77:0/3536092330 >> v2:10.20.193.119:3300/0 conn(0x7fc3940a2d50 0x7fc39413cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 1 -- 10.20.193.77:0/3536092330 >> v1:10.20.193.119:6789/0 conn(0x7fc39409c420 legacy=0x7fc3940a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:17.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 10 monclient: _finish_hunting 0 2026-02-17T12:05:17.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 1 monclient: found mon.noname-a 2026-02-17T12:05:17.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:17.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.102+0000 7fc3927fc640 1 -- 10.20.193.77:0/3536092330 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39409f860 con 0x7fc3940a2920 2026-02-17T12:05:17.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc3927fc640 1 -- 10.20.193.77:0/3536092330 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc3940a2920 msgr2=0x7fc39413a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:17.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc3927fc640 1 --2- 10.20.193.77:0/3536092330 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc3940a2920 0x7fc39413a990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc39409f140 tx=0x7fc37c01c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20babcac04873297 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.118 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc391ffb640 1 -- 10.20.193.77:0/3536092330 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c0b0070 con 0x7fc3940a2920 2026-02-17T12:05:17.118 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc391ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.118 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc391ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:17.118 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc391ffb640 10 monclient: dump: 2026-02-17T12:05:17.118 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.119 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.119 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.119 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.119 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.119 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.119 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.119 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.119 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.119 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc391ffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:17.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc391ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:17.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc391ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:17.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc391ffb640 1 -- 10.20.193.77:0/3536092330 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37c004230 con 0x7fc3940a2920 2026-02-17T12:05:17.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc399703640 5 monclient: authenticate success, global_id 4293 2026-02-17T12:05:17.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc399703640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:17.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc391ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:17.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc391ffb640 1 -- 10.20.193.77:0/3536092330 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c003720 con 0x7fc3940a2920 2026-02-17T12:05:17.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc391ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc391ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:17.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc391ffb640 10 monclient: dump: 2026-02-17T12:05:17.121 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.121 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.121 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.121 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.121 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.121 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.121 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.121 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.121 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.121 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.121 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc399703640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:17.121 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc399703640 4 set_mon_vals no callback set 2026-02-17T12:05:17.121 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc399703640 10 monclient: shutdown 2026-02-17T12:05:17.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc399703640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:17.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc399703640 1 -- 10.20.193.77:0/3536092330 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc3940a2920 msgr2=0x7fc39413a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc399703640 1 --2- 10.20.193.77:0/3536092330 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc3940a2920 0x7fc39413a990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc39409f140 tx=0x7fc37c01c590 comp rx=0 tx=0).stop 2026-02-17T12:05:17.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc399703640 1 -- 10.20.193.77:0/3536092330 shutdown_connections 2026-02-17T12:05:17.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc399703640 1 --2- 10.20.193.77:0/3536092330 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc3940a2920 0x7fc39413a990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc399703640 1 --2- 10.20.193.77:0/3536092330 >> v2:10.20.193.119:3300/0 conn(0x7fc3940a2d50 0x7fc39413cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc399703640 1 -- 10.20.193.77:0/3536092330 >> 10.20.193.77:0/3536092330 conn(0x7fc3940a73c0 msgr2=0x7fc3940a3300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:17.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc399703640 1 -- 10.20.193.77:0/3536092330 shutdown_connections 2026-02-17T12:05:17.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.106+0000 7fc399703640 1 -- 10.20.193.77:0/3536092330 wait complete. 2026-02-17T12:05:17.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient: build_initial_monmap 2026-02-17T12:05:17.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient: monmap: 2026-02-17T12:05:17.122 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:17.123 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:17.123 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:17.123 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:17.123 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:17.123 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.123 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:17.123 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:17.123 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:17.123 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.123 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 1 Processor -- start 2026-02-17T12:05:17.123 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 1 -- start start 2026-02-17T12:05:17.123 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient: init 2026-02-17T12:05:17.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:17.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:05:17.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc39409c420 0x7fc394098130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient(hunting): picked mon.noname-a con 0x7fc39409c420 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:17.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc3940a2920 0x7fc394095250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient(hunting): picked mon.noname-c con 0x7fc3940a2920 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:17.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc3940a2d50 0x7fc394095790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient(hunting): picked mon.noname-b con 0x7fc3940a2d50 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:17.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3940a0340 con 0x7fc39409c420 2026-02-17T12:05:17.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.124 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc3940a01c0 con 0x7fc3940a2d50 2026-02-17T12:05:17.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc39413fc40 con 0x7fc3940a2920 2026-02-17T12:05:17.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:17.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient(hunting): authenticate will time out at 568.788503s 2026-02-17T12:05:17.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc39409c420 0x7fc394098130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc39409c420 0x7fc394098130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44548/0 (socket says 10.20.193.77:44548) 2026-02-17T12:05:17.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 1 -- 10.20.193.77:0/68286779 learned_addr learned my addr 10.20.193.77:0/68286779 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:17.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 10 monclient(hunting): get_auth_request con 0x7fc39409c420 auth_method 0 2026-02-17T12:05:17.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.125 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3927fc640 1 --2- 10.20.193.77:0/68286779 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc3940a2920 0x7fc394095250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3927fc640 10 monclient(hunting): get_auth_request con 0x7fc3940a2920 auth_method 0 2026-02-17T12:05:17.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3927fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3927fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3927fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3927fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3927fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 10 monclient(hunting): handle_auth_done global_id 4296 payload 824 2026-02-17T12:05:17.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3937fe640 1 --2- 10.20.193.77:0/68286779 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc3940a2d50 0x7fc394095790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 1 -- 10.20.193.77:0/68286779 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc3940a2920 msgr2=0x7fc394095250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 1 --2- 10.20.193.77:0/68286779 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc3940a2920 0x7fc394095250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 1 -- 10.20.193.77:0/68286779 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc3940a2d50 msgr2=0x7fc394095790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 1 --2- 10.20.193.77:0/68286779 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc3940a2d50 0x7fc394095790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:05:17.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 1 monclient: found mon.noname-a 2026-02-17T12:05:17.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:17.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 1 -- 10.20.193.77:0/68286779 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3940a4c60 con 0x7fc39409c420 2026-02-17T12:05:17.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3937fe640 10 monclient: get_auth_request con 0x7fc3940a2d50 auth_method 0 2026-02-17T12:05:17.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3937fe640 1 --2- 10.20.193.77:0/68286779 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc3940a2d50 0x7fc394095790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:05:17.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 1 -- 10.20.193.77:0/68286779 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc39409c420 msgr2=0x7fc394098130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:17.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc392ffd640 1 --2- 10.20.193.77:0/68286779 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc39409c420 0x7fc394098130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc38800c550 tx=0x7fc38800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3737fe640 1 -- 10.20.193.77:0/68286779 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388016020 con 0x7fc39409c420 2026-02-17T12:05:17.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3737fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:17.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3737fe640 10 monclient: dump: 2026-02-17T12:05:17.128 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.128 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.128 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.128 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.128 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.128 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.128 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.129 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.129 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.129 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3737fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:17.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3737fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:17.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:17.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3737fe640 1 -- 10.20.193.77:0/68286779 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc388012a60 con 0x7fc39409c420 2026-02-17T12:05:17.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 5 monclient: authenticate success, global_id 4296 2026-02-17T12:05:17.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient: _renew_subs 2026-02-17T12:05:17.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 1 -- 10.20.193.77:0/68286779 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc394098c20 con 0x7fc39409c420 2026-02-17T12:05:17.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3737fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:17.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3737fe640 1 -- 10.20.193.77:0/68286779 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388012e50 con 0x7fc39409c420 2026-02-17T12:05:17.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3737fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:17.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3737fe640 10 monclient: dump: 2026-02-17T12:05:17.130 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.130 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.130 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.130 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.130 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.130 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.130 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.130 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.130 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.131 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3917fa640 4 set_mon_vals no callback set 2026-02-17T12:05:17.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient: _renew_subs 2026-02-17T12:05:17.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 1 -- 10.20.193.77:0/68286779 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc394073ba0 con 0x7fc39409c420 2026-02-17T12:05:17.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc3737fe640 1 -- 10.20.193.77:0/68286779 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fc38801b400 con 0x7fc39409c420 2026-02-17T12:05:17.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.110+0000 7fc399703640 1 -- 10.20.193.77:0/68286779 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3940a2210 con 0x7fc39409c420 2026-02-17T12:05:17.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.114+0000 7fc3737fe640 1 --2- 10.20.193.77:0/68286779 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc36003a310 0x7fc36003c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.114+0000 7fc3737fe640 1 -- 10.20.193.77:0/68286779 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7fc38804dd00 con 0x7fc39409c420 2026-02-17T12:05:17.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.114+0000 7fc3927fc640 1 --2- 10.20.193.77:0/68286779 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc36003a310 0x7fc36003c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.114+0000 7fc3927fc640 10 monclient: get_auth_request con 0x7fc36003a310 auth_method 0 2026-02-17T12:05:17.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.114+0000 7fc3737fe640 1 -- 10.20.193.77:0/68286779 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7fc388020020 con 0x7fc39409c420 2026-02-17T12:05:17.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.114+0000 7fc3737fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.114+0000 7fc3737fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:17.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.114+0000 7fc3927fc640 1 --2- 10.20.193.77:0/68286779 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc36003a310 0x7fc36003c7d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc39406ea00 tx=0x7fc37c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T12:05:17.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T12:05:17.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 1 -- 10.20.193.77:0/68286779 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc3940977d0 con 0x7fc39409c420 2026-02-17T12:05:17.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc3737fe640 1 -- 10.20.193.77:0/68286779 <== mon.0 v2:10.20.193.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc3940a4c60 con 0x7fc39409c420 2026-02-17T12:05:17.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc3737fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T12:05:17.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc3737fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:17.194 INFO:teuthology.orchestra.run.trial077.stdout:47244640260 2026-02-17T12:05:17.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 1 -- 10.20.193.77:0/68286779 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc36003a310 msgr2=0x7fc36003c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 1 --2- 10.20.193.77:0/68286779 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc36003a310 0x7fc36003c7d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc39406ea00 tx=0x7fc37c0a6000 comp rx=0 tx=0).stop 2026-02-17T12:05:17.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 10 monclient: shutdown 2026-02-17T12:05:17.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:17.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 1 -- 10.20.193.77:0/68286779 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc39409c420 msgr2=0x7fc394098130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 1 --2- 10.20.193.77:0/68286779 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc39409c420 0x7fc394098130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc38800c550 tx=0x7fc38800ca10 comp rx=0 tx=0).stop 2026-02-17T12:05:17.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 1 -- 10.20.193.77:0/68286779 shutdown_connections 2026-02-17T12:05:17.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 1 --2- 10.20.193.77:0/68286779 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc36003a310 0x7fc36003c7d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 1 --2- 10.20.193.77:0/68286779 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc3940a2d50 0x7fc394095790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 1 --2- 10.20.193.77:0/68286779 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc3940a2920 0x7fc394095250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 1 --2- 10.20.193.77:0/68286779 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc39409c420 0x7fc394098130 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 1 -- 10.20.193.77:0/68286779 >> 10.20.193.77:0/68286779 conn(0x7fc3940a73c0 msgr2=0x7fc3940a53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:17.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 1 -- 10.20.193.77:0/68286779 shutdown_connections 2026-02-17T12:05:17.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.190+0000 7fc399703640 1 -- 10.20.193.77:0/68286779 wait complete. 2026-02-17T12:05:17.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.0 2026-02-17T12:05:17.206 DEBUG:teuthology.parallel:result is None 2026-02-17T12:05:17.239 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T12:05:17.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 10 monclient: get_monmap_and_config 2026-02-17T12:05:17.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 10 monclient: build_initial_monmap 2026-02-17T12:05:17.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 10 monclient: monmap: 2026-02-17T12:05:17.312 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:17.312 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.312 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:17.311483+0000 2026-02-17T12:05:17.312 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:17.311483+0000 2026-02-17T12:05:17.312 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:17.312 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.312 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:17.312 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:17.312 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:17.312 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:17.312 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:17.313 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 1 Processor -- start 2026-02-17T12:05:17.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 1 -- start start 2026-02-17T12:05:17.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 10 monclient: init 2026-02-17T12:05:17.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:17.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 10 monclient: _add_conns ranks=[1,3,4,2,0] 2026-02-17T12:05:17.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5ff4068460 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:17.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f5ff4138a30 0x7f5ff413d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 10 monclient(hunting): picked mon.noname-a con 0x7f5ff4138a30 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:17.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f5ff413d6a0 0x7f5ff413fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 10 monclient(hunting): picked mon.noname-c con 0x7f5ff413d6a0 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:17.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff40a10f0 con 0x7f5ff4068460 2026-02-17T12:05:17.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5ff4068840 con 0x7f5ff4138a30 2026-02-17T12:05:17.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f5ff406fce0 con 0x7f5ff413d6a0 2026-02-17T12:05:17.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:17.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff3577640 10 monclient(hunting): authenticate will time out at 568.986930s 2026-02-17T12:05:17.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f5ff4138a30 0x7f5ff413d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f5ff4138a30 0x7f5ff413d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44554/0 (socket says 10.20.193.77:44554) 2026-02-17T12:05:17.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 1 -- 10.20.193.77:0/3159746892 learned_addr learned my addr 10.20.193.77:0/3159746892 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:17.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 10 monclient(hunting): get_auth_request con 0x7f5ff4138a30 auth_method 0 2026-02-17T12:05:17.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff2d76640 1 --2- 10.20.193.77:0/3159746892 >> v2:10.20.193.119:3300/0 conn(0x7f5ff413d6a0 0x7f5ff413fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff2d76640 10 monclient(hunting): get_auth_request con 0x7f5ff413d6a0 auth_method 0 2026-02-17T12:05:17.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 10 monclient(hunting): handle_auth_done global_id 4299 payload 274 2026-02-17T12:05:17.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 1 -- 10.20.193.77:0/3159746892 >> v2:10.20.193.119:3300/0 conn(0x7f5ff413d6a0 msgr2=0x7f5ff413fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:17.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 1 --2- 10.20.193.77:0/3159746892 >> v2:10.20.193.119:3300/0 conn(0x7f5ff413d6a0 0x7f5ff413fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 1 -- 10.20.193.77:0/3159746892 >> v1:10.20.193.119:6789/0 conn(0x7f5ff4068460 legacy=0x7f5ff4138320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:17.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 10 monclient: _finish_hunting 0 2026-02-17T12:05:17.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 1 monclient: found mon.noname-a 2026-02-17T12:05:17.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:17.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.306+0000 7f5ff1d74640 1 -- 10.20.193.77:0/3159746892 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff406ffc0 con 0x7f5ff4138a30 2026-02-17T12:05:17.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1d74640 1 -- 10.20.193.77:0/3159746892 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5ff4138a30 msgr2=0x7f5ff413d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:17.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1d74640 1 --2- 10.20.193.77:0/3159746892 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5ff4138a30 0x7f5ff413d160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40a4c40 tx=0x7f5fdc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3737afb4f5032542 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1573640 1 -- 10.20.193.77:0/3159746892 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc0b0070 con 0x7f5ff4138a30 2026-02-17T12:05:17.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:17.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1573640 10 monclient: dump: 2026-02-17T12:05:17.324 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.324 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.324 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.324 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.324 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.324 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.324 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.324 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.324 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.325 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1573640 10 monclient: _finish_auth 0 2026-02-17T12:05:17.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1573640 10 monclient: _check_auth_tickets 2026-02-17T12:05:17.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:17.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1573640 1 -- 10.20.193.77:0/3159746892 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fdc004230 con 0x7f5ff4138a30 2026-02-17T12:05:17.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:17.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1573640 1 -- 10.20.193.77:0/3159746892 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc003720 con 0x7f5ff4138a30 2026-02-17T12:05:17.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 5 monclient: authenticate success, global_id 4299 2026-02-17T12:05:17.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:17.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 4 set_mon_vals no callback set 2026-02-17T12:05:17.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:17.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff1573640 10 monclient: dump: 2026-02-17T12:05:17.326 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.326 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.326 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.326 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.326 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.326 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.326 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.326 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.326 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.326 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 10 monclient: shutdown 2026-02-17T12:05:17.326 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:17.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 1 -- 10.20.193.77:0/3159746892 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5ff4138a30 msgr2=0x7f5ff413d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 1 --2- 10.20.193.77:0/3159746892 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5ff4138a30 0x7f5ff413d160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40a4c40 tx=0x7f5fdc01c560 comp rx=0 tx=0).stop 2026-02-17T12:05:17.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 1 -- 10.20.193.77:0/3159746892 shutdown_connections 2026-02-17T12:05:17.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 1 --2- 10.20.193.77:0/3159746892 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5ff4138a30 0x7f5ff413d160 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 1 --2- 10.20.193.77:0/3159746892 >> v2:10.20.193.119:3300/0 conn(0x7f5ff413d6a0 0x7f5ff413fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 1 -- 10.20.193.77:0/3159746892 >> 10.20.193.77:0/3159746892 conn(0x7f5ff40a7390 msgr2=0x7f5ff40a3890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:17.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 1 -- 10.20.193.77:0/3159746892 shutdown_connections 2026-02-17T12:05:17.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 1 -- 10.20.193.77:0/3159746892 wait complete. 2026-02-17T12:05:17.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 10 monclient: build_initial_monmap 2026-02-17T12:05:17.327 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 10 monclient: monmap: 2026-02-17T12:05:17.327 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:17.327 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:17.328 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:17.328 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:17.328 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:17.328 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.328 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:17.328 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:17.328 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:17.328 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 1 Processor -- start 2026-02-17T12:05:17.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 1 -- start start 2026-02-17T12:05:17.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.310+0000 7f5ff3577640 10 monclient: init 2026-02-17T12:05:17.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:17.328 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:17.329 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5ff4068460 0x7f5ff4071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.329 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient(hunting): picked mon.noname-b con 0x7f5ff4068460 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:17.329 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5ff4138a30 0x7f5ff4071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.329 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient(hunting): picked mon.noname-c con 0x7f5ff4138a30 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:17.329 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5ff413d6a0 0x7f5ff41d1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.329 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient(hunting): picked mon.noname-a con 0x7f5ff413d6a0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:17.329 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.329 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff4142970 con 0x7f5ff413d6a0 2026-02-17T12:05:17.329 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.329 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff41427f0 con 0x7f5ff4068460 2026-02-17T12:05:17.329 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.329 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff4142af0 con 0x7f5ff4138a30 2026-02-17T12:05:17.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:17.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient(hunting): authenticate will time out at 568.992247s 2026-02-17T12:05:17.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5ff413d6a0 0x7f5ff41d1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5ff413d6a0 0x7f5ff41d1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44558/0 (socket says 10.20.193.77:44558) 2026-02-17T12:05:17.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 1 -- 10.20.193.77:0/2780410873 learned_addr learned my addr 10.20.193.77:0/2780410873 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:17.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 10 monclient(hunting): get_auth_request con 0x7f5ff413d6a0 auth_method 0 2026-02-17T12:05:17.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff1d74640 1 --2- 10.20.193.77:0/2780410873 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5ff4138a30 0x7f5ff4071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff1d74640 10 monclient(hunting): get_auth_request con 0x7f5ff4138a30 auth_method 0 2026-02-17T12:05:17.330 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2575640 1 --2- 10.20.193.77:0/2780410873 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5ff4068460 0x7f5ff4071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2575640 10 monclient(hunting): get_auth_request con 0x7f5ff4068460 auth_method 0 2026-02-17T12:05:17.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.331 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 10 monclient(hunting): handle_auth_done global_id 4302 payload 824 2026-02-17T12:05:17.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 1 -- 10.20.193.77:0/2780410873 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5ff4138a30 msgr2=0x7f5ff4071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 1 --2- 10.20.193.77:0/2780410873 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5ff4138a30 0x7f5ff4071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 1 -- 10.20.193.77:0/2780410873 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5ff4068460 msgr2=0x7f5ff4071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 1 --2- 10.20.193.77:0/2780410873 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5ff4068460 0x7f5ff4071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 10 monclient: _finish_hunting 0 2026-02-17T12:05:17.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 1 monclient: found mon.noname-a 2026-02-17T12:05:17.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:17.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.332 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 1 -- 10.20.193.77:0/2780410873 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff413d220 con 0x7f5ff413d6a0 2026-02-17T12:05:17.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 1 -- 10.20.193.77:0/2780410873 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5ff413d6a0 msgr2=0x7f5ff41d1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:17.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2d76640 1 --2- 10.20.193.77:0/2780410873 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5ff413d6a0 0x7f5ff41d1ce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4007e70 tx=0x7f5fe400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 1 -- 10.20.193.77:0/2780410873 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4013790 con 0x7f5ff413d6a0 2026-02-17T12:05:17.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:17.333 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 10 monclient: dump: 2026-02-17T12:05:17.333 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.333 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.333 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.333 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.333 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.333 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.333 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.334 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.334 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.334 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.334 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:17.334 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:17.334 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:17.334 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 1 -- 10.20.193.77:0/2780410873 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe4019070 con 0x7f5ff413d6a0 2026-02-17T12:05:17.334 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:17.334 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 1 -- 10.20.193.77:0/2780410873 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4013b90 con 0x7f5ff413d6a0 2026-02-17T12:05:17.334 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.334 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:17.334 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 10 monclient: dump: 2026-02-17T12:05:17.334 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.335 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.335 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.335 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.335 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.335 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.335 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.335 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.335 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.335 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff0d72640 4 set_mon_vals no callback set 2026-02-17T12:05:17.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 5 monclient: authenticate success, global_id 4302 2026-02-17T12:05:17.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient: _renew_subs 2026-02-17T12:05:17.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 1 -- 10.20.193.77:0/2780410873 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff413fd30 con 0x7f5ff413d6a0 2026-02-17T12:05:17.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient: _renew_subs 2026-02-17T12:05:17.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 1 -- 10.20.193.77:0/2780410873 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff4073820 con 0x7f5ff413d6a0 2026-02-17T12:05:17.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff3577640 1 -- 10.20.193.77:0/2780410873 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff4074d10 con 0x7f5ff413d6a0 2026-02-17T12:05:17.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 1 -- 10.20.193.77:0/2780410873 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f5fe401e460 con 0x7f5ff413d6a0 2026-02-17T12:05:17.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 1 --2- 10.20.193.77:0/2780410873 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5fc003a170 0x7f5fc003c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5fdaffd640 1 -- 10.20.193.77:0/2780410873 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7f5fe404e1d0 con 0x7f5ff413d6a0 2026-02-17T12:05:17.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2575640 1 --2- 10.20.193.77:0/2780410873 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5fc003a170 0x7f5fc003c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.314+0000 7f5ff2575640 10 monclient: get_auth_request con 0x7f5fc003a170 auth_method 0 2026-02-17T12:05:17.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.318+0000 7f5ff2575640 1 --2- 10.20.193.77:0/2780410873 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5fc003a170 0x7f5fc003c630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8005030 tx=0x7f5fe8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.336 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.318+0000 7f5fdaffd640 1 -- 10.20.193.77:0/2780410873 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f5fe4013d30 con 0x7f5ff413d6a0 2026-02-17T12:05:17.337 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.318+0000 7f5fdaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.337 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.318+0000 7f5fdaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:17.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T12:05:17.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T12:05:17.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 1 -- 10.20.193.77:0/2780410873 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5ff40720f0 con 0x7f5ff413d6a0 2026-02-17T12:05:17.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5fdaffd640 1 -- 10.20.193.77:0/2780410873 <== mon.0 v2:10.20.193.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5fe4012d60 con 0x7f5ff413d6a0 2026-02-17T12:05:17.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5fdaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T12:05:17.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5fdaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:17.400 INFO:teuthology.orchestra.run.trial077.stdout:51539607556 2026-02-17T12:05:17.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 1 -- 10.20.193.77:0/2780410873 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5fc003a170 msgr2=0x7f5fc003c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 1 --2- 10.20.193.77:0/2780410873 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5fc003a170 0x7f5fc003c630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8005030 tx=0x7f5fe8009040 comp rx=0 tx=0).stop 2026-02-17T12:05:17.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 10 monclient: shutdown 2026-02-17T12:05:17.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:17.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 1 -- 10.20.193.77:0/2780410873 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5ff413d6a0 msgr2=0x7f5ff41d1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 1 --2- 10.20.193.77:0/2780410873 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5ff413d6a0 0x7f5ff41d1ce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4007e70 tx=0x7f5fe400e4b0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 1 -- 10.20.193.77:0/2780410873 shutdown_connections 2026-02-17T12:05:17.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 1 --2- 10.20.193.77:0/2780410873 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5fc003a170 0x7f5fc003c630 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 1 --2- 10.20.193.77:0/2780410873 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f5ff413d6a0 0x7f5ff41d1ce0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 1 --2- 10.20.193.77:0/2780410873 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f5ff4138a30 0x7f5ff4071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 1 --2- 10.20.193.77:0/2780410873 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5ff4068460 0x7f5ff4071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 1 -- 10.20.193.77:0/2780410873 >> 10.20.193.77:0/2780410873 conn(0x7f5ff40a7390 msgr2=0x7f5ff4137010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:17.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 1 -- 10.20.193.77:0/2780410873 shutdown_connections 2026-02-17T12:05:17.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.398+0000 7f5ff3577640 1 -- 10.20.193.77:0/2780410873 wait complete. 2026-02-17T12:05:17.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607556 for osd.1 2026-02-17T12:05:17.410 DEBUG:teuthology.parallel:result is None 2026-02-17T12:05:17.410 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T12:05:17.410 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:05:17.472 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.466+0000 7fb283f63640 10 monclient: get_monmap_and_config 2026-02-17T12:05:17.472 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.466+0000 7fb283f63640 10 monclient: build_initial_monmap 2026-02-17T12:05:17.472 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.466+0000 7fb283f63640 10 monclient: monmap: 2026-02-17T12:05:17.472 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:17.473 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.473 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:17.472954+0000 2026-02-17T12:05:17.473 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:17.472954+0000 2026-02-17T12:05:17.473 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:17.473 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.473 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:17.473 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:17.473 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:17.473 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:17.473 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:17.473 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.473 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 1 Processor -- start 2026-02-17T12:05:17.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 1 -- start start 2026-02-17T12:05:17.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 10 monclient: init 2026-02-17T12:05:17.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:17.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 10 monclient: _add_conns ranks=[2,1,0,4,3] 2026-02-17T12:05:17.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5430 0x7fb27c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 10 monclient(hunting): picked mon.noname-b con 0x7fb27c0a5430 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:17.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb27c0a5d50 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:17.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb27c138b00 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:17.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb27c0a7050 con 0x7fb27c138b00 2026-02-17T12:05:17.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb27c09d250 con 0x7fb27c0a5d50 2026-02-17T12:05:17.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb27c0a44e0 con 0x7fb27c0a5430 2026-02-17T12:05:17.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:17.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 10 monclient(hunting): authenticate will time out at 569.148369s 2026-02-17T12:05:17.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5430 0x7fb27c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5430 0x7fb27c0a5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50886/0 (socket says 10.20.193.77:50886) 2026-02-17T12:05:17.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 1 -- 10.20.193.77:0/2523960779 learned_addr learned my addr 10.20.193.77:0/2523960779 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:17.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 10 monclient(hunting): get_auth_request con 0x7fb27c0a5430 auth_method 0 2026-02-17T12:05:17.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.476 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 10 monclient(hunting): handle_auth_done global_id 4298 payload 274 2026-02-17T12:05:17.476 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 1 -- 10.20.193.77:0/2523960779 >> v1:10.20.193.119:6789/0 conn(0x7fb27c0a5d50 legacy=0x7fb27c1383f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:17.476 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 1 -- 10.20.193.77:0/2523960779 >> v1:10.20.193.77:6789/0 conn(0x7fb27c138b00 legacy=0x7fb27c140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:17.476 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 10 monclient: _finish_hunting 0 2026-02-17T12:05:17.476 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 1 monclient: found mon.noname-b 2026-02-17T12:05:17.476 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:17.476 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:17.476 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 1 -- 10.20.193.77:0/2523960779 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27c0a6950 con 0x7fb27c0a5430 2026-02-17T12:05:17.482 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 1 -- 10.20.193.77:0/2523960779 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5430 msgr2=0x7fb27c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:17.482 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb281cd8640 1 --2- 10.20.193.77:0/2523960779 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5430 0x7fb27c0a5810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0099a0 tx=0x7fb26c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=299f9327b06e6de9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.482 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb280cd6640 1 -- 10.20.193.77:0/2523960779 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0b0070 con 0x7fb27c0a5430 2026-02-17T12:05:17.482 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb280cd6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.483 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb280cd6640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:17.483 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb280cd6640 10 monclient: dump: 2026-02-17T12:05:17.483 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.483 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.483 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.483 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.483 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.483 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.483 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.483 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.483 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.484 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb280cd6640 10 monclient: _finish_auth 0 2026-02-17T12:05:17.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb280cd6640 10 monclient: _check_auth_tickets 2026-02-17T12:05:17.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb280cd6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:17.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb280cd6640 1 -- 10.20.193.77:0/2523960779 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26c004230 con 0x7fb27c0a5430 2026-02-17T12:05:17.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb280cd6640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:17.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb280cd6640 1 -- 10.20.193.77:0/2523960779 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c003720 con 0x7fb27c0a5430 2026-02-17T12:05:17.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 5 monclient: authenticate success, global_id 4298 2026-02-17T12:05:17.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:17.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb283f63640 4 set_mon_vals no callback set 2026-02-17T12:05:17.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb280cd6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.484 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb280cd6640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:17.485 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.470+0000 7fb280cd6640 10 monclient: dump: 2026-02-17T12:05:17.485 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.485 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.485 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.485 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.485 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.485 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.485 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.485 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.485 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.485 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.485 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 10 monclient: shutdown 2026-02-17T12:05:17.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:17.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 -- 10.20.193.77:0/2523960779 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5430 msgr2=0x7fb27c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 --2- 10.20.193.77:0/2523960779 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5430 0x7fb27c0a5810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0099a0 tx=0x7fb26c01c560 comp rx=0 tx=0).stop 2026-02-17T12:05:17.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 -- 10.20.193.77:0/2523960779 shutdown_connections 2026-02-17T12:05:17.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 --2- 10.20.193.77:0/2523960779 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5430 0x7fb27c0a5810 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 -- 10.20.193.77:0/2523960779 >> 10.20.193.77:0/2523960779 conn(0x7fb27c0aac30 msgr2=0x7fb27c0ab040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:17.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 -- 10.20.193.77:0/2523960779 shutdown_connections 2026-02-17T12:05:17.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 -- 10.20.193.77:0/2523960779 wait complete. 2026-02-17T12:05:17.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 10 monclient: build_initial_monmap 2026-02-17T12:05:17.486 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 10 monclient: monmap: 2026-02-17T12:05:17.486 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:17.486 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:17.487 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:17.487 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:17.487 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:17.487 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.487 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:17.487 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:17.487 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:17.487 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.487 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 Processor -- start 2026-02-17T12:05:17.487 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 -- start start 2026-02-17T12:05:17.487 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 10 monclient: init 2026-02-17T12:05:17.487 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:17.487 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:05:17.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fb27c0a5430 0x7fb27c1d25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 10 monclient(hunting): picked mon.noname-a con 0x7fb27c0a5430 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:17.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5d50 0x7fb27c137bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 10 monclient(hunting): picked mon.noname-c con 0x7fb27c0a5d50 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:17.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb27c138b00 0x7fb27c13dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 10 monclient(hunting): picked mon.noname-b con 0x7fb27c138b00 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:17.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c09c2b0 con 0x7fb27c0a5430 2026-02-17T12:05:17.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c09c130 con 0x7fb27c138b00 2026-02-17T12:05:17.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb27c09c640 con 0x7fb27c0a5d50 2026-02-17T12:05:17.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:17.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb283f63640 10 monclient(hunting): authenticate will time out at 569.153629s 2026-02-17T12:05:17.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb281cd8640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fb27c0a5430 0x7fb27c1d25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb281cd8640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fb27c0a5430 0x7fb27c1d25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44564/0 (socket says 10.20.193.77:44564) 2026-02-17T12:05:17.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb281cd8640 1 -- 10.20.193.77:0/3940902881 learned_addr learned my addr 10.20.193.77:0/3940902881 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:17.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb281cd8640 10 monclient(hunting): get_auth_request con 0x7fb27c0a5430 auth_method 0 2026-02-17T12:05:17.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb281cd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb281cd8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb281cd8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 1 --2- 10.20.193.77:0/3940902881 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5d50 0x7fb27c137bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 10 monclient(hunting): get_auth_request con 0x7fb27c0a5d50 auth_method 0 2026-02-17T12:05:17.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb281cd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb281cd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb281cd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2824d9640 1 --2- 10.20.193.77:0/3940902881 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb27c138b00 0x7fb27c13dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2824d9640 10 monclient(hunting): get_auth_request con 0x7fb27c138b00 auth_method 0 2026-02-17T12:05:17.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2824d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2824d9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2824d9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 10 monclient(hunting): handle_auth_done global_id 4301 payload 824 2026-02-17T12:05:17.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 1 -- 10.20.193.77:0/3940902881 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb27c138b00 msgr2=0x7fb27c13dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 1 --2- 10.20.193.77:0/3940902881 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb27c138b00 0x7fb27c13dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 1 -- 10.20.193.77:0/3940902881 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fb27c0a5430 msgr2=0x7fb27c1d25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 1 --2- 10.20.193.77:0/3940902881 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fb27c0a5430 0x7fb27c1d25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 10 monclient: _finish_hunting 0 2026-02-17T12:05:17.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 1 monclient: found mon.noname-c 2026-02-17T12:05:17.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:17.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:17.492 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb2814d7640 1 -- 10.20.193.77:0/3940902881 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27c1413c0 con 0x7fb27c0a5d50 2026-02-17T12:05:17.492 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.474+0000 7fb281cd8640 1 --2- 10.20.193.77:0/3940902881 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fb27c0a5430 0x7fb27c1d25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:17.492 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb2814d7640 1 -- 10.20.193.77:0/3940902881 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5d50 msgr2=0x7fb27c137bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:17.492 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb2814d7640 1 --2- 10.20.193.77:0/3940902881 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5d50 0x7fb27c137bc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0a53e0 tx=0x7fb27000c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.492 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 1 -- 10.20.193.77:0/3940902881 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb270016070 con 0x7fb27c0a5d50 2026-02-17T12:05:17.492 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.492 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:17.492 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 10 monclient: dump: 2026-02-17T12:05:17.492 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.492 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.492 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.492 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.493 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.493 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.493 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.493 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.493 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.493 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:17.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:17.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:17.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 1 -- 10.20.193.77:0/3940902881 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb270006ae0 con 0x7fb27c0a5d50 2026-02-17T12:05:17.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:17.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 1 -- 10.20.193.77:0/3940902881 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb270005020 con 0x7fb27c0a5d50 2026-02-17T12:05:17.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:17.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 10 monclient: dump: 2026-02-17T12:05:17.494 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.494 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.494 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.494 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.494 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.494 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.494 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.494 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.494 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.494 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26bfff640 4 set_mon_vals no callback set 2026-02-17T12:05:17.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb283f63640 5 monclient: authenticate success, global_id 4301 2026-02-17T12:05:17.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb283f63640 10 monclient: _renew_subs 2026-02-17T12:05:17.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb283f63640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:17.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb283f63640 1 -- 10.20.193.77:0/3940902881 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27c1406f0 con 0x7fb27c0a5d50 2026-02-17T12:05:17.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb283f63640 10 monclient: _renew_subs 2026-02-17T12:05:17.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb283f63640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:17.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb283f63640 1 -- 10.20.193.77:0/3940902881 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb27c09e7e0 con 0x7fb27c0a5d50 2026-02-17T12:05:17.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb283f63640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb283f63640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb283f63640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:17.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb283f63640 1 -- 10.20.193.77:0/3940902881 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb27c0a5810 con 0x7fb27c0a5d50 2026-02-17T12:05:17.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 1 -- 10.20.193.77:0/3940902881 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fb270005280 con 0x7fb27c0a5d50 2026-02-17T12:05:17.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 1 --2- 10.20.193.77:0/3940902881 >> v2:10.20.193.119:6800/4127986552 conn(0x7fb24c03a120 0x7fb24c03c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb26a7fc640 1 -- 10.20.193.77:0/3940902881 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7fb27004d630 con 0x7fb27c0a5d50 2026-02-17T12:05:17.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb281cd8640 1 --2- 10.20.193.77:0/3940902881 >> v2:10.20.193.119:6800/4127986552 conn(0x7fb24c03a120 0x7fb24c03c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb281cd8640 10 monclient: get_auth_request con 0x7fb24c03a120 auth_method 0 2026-02-17T12:05:17.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.478+0000 7fb281cd8640 1 --2- 10.20.193.77:0/3940902881 >> v2:10.20.193.119:6800/4127986552 conn(0x7fb24c03a120 0x7fb24c03c5e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0098f0 tx=0x7fb26c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.497 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.482+0000 7fb26a7fc640 1 -- 10.20.193.77:0/3940902881 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7fb270019d90 con 0x7fb27c0a5d50 2026-02-17T12:05:17.497 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.482+0000 7fb26a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.497 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.482+0000 7fb26a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:17.556 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 1 -- 10.20.193.77:0/3940902881 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb27c1417d0 con 0x7fb24c03a120 2026-02-17T12:05:17.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb26a7fc640 1 -- 10.20.193.77:0/3940902881 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34183 (secure 0 0 0) 0x7fb27c1417d0 con 0x7fb24c03a120 2026-02-17T12:05:17.558 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:05:17.559 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T12:05:17.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 1 -- 10.20.193.77:0/3940902881 >> v2:10.20.193.119:6800/4127986552 conn(0x7fb24c03a120 msgr2=0x7fb24c03c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 1 --2- 10.20.193.77:0/3940902881 >> v2:10.20.193.119:6800/4127986552 conn(0x7fb24c03a120 0x7fb24c03c5e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0098f0 tx=0x7fb26c0a6000 comp rx=0 tx=0).stop 2026-02-17T12:05:17.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 10 monclient: shutdown 2026-02-17T12:05:17.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:17.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 1 -- 10.20.193.77:0/3940902881 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5d50 msgr2=0x7fb27c137bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 1 --2- 10.20.193.77:0/3940902881 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5d50 0x7fb27c137bc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0a53e0 tx=0x7fb27000c9b0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 1 -- 10.20.193.77:0/3940902881 shutdown_connections 2026-02-17T12:05:17.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 1 --2- 10.20.193.77:0/3940902881 >> v2:10.20.193.119:6800/4127986552 conn(0x7fb24c03a120 0x7fb24c03c5e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 1 --2- 10.20.193.77:0/3940902881 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fb27c138b00 0x7fb27c13dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 1 --2- 10.20.193.77:0/3940902881 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fb27c0a5d50 0x7fb27c137bc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 1 --2- 10.20.193.77:0/3940902881 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fb27c0a5430 0x7fb27c1d25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 1 -- 10.20.193.77:0/3940902881 >> 10.20.193.77:0/3940902881 conn(0x7fb27c0aac30 msgr2=0x7fb27c0a1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:17.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 1 -- 10.20.193.77:0/3940902881 shutdown_connections 2026-02-17T12:05:17.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.554+0000 7fb283f63640 1 -- 10.20.193.77:0/3940902881 wait complete. 2026-02-17T12:05:17.568 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-17T12:05:16.269218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":183680,"kb_used_data":1088,"kb_used_omap":9,"kb_used_meta":182454,"kb_avail":566047360,"statfs":{"total":579820584960,"available":579632496640,"internally_reserved":0,"allocated":1114112,"data_stored":1371693,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":186833575},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.999164"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.474034+0000","last_change":"2026-02-17T12:05:14.474034+0000","last_active":"2026-02-17T12:05:14.474034+0000","last_peered":"2026-02-17T12:05:14.474034+0000","last_clean":"2026-02-17T12:05:14.474034+0000","last_became_active":"2026-02-17T12:05:12.276658+0000","last_became_peered":"2026-02-17T12:05:12.276658+0000","last_unstale":"2026-02-17T12:05:14.474034+0000","last_undegraded":"2026-02-17T12:05:14.474034+0000","last_fullsized":"2026-02-17T12:05:14.474034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:42:47.843930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048223100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.478866+0000","last_change":"2026-02-17T12:05:14.478866+0000","last_active":"2026-02-17T12:05:14.478866+0000","last_peered":"2026-02-17T12:05:14.478866+0000","last_clean":"2026-02-17T12:05:14.478866+0000","last_became_active":"2026-02-17T12:05:12.278326+0000","last_became_peered":"2026-02-17T12:05:12.278326+0000","last_unstale":"2026-02-17T12:05:14.478866+0000","last_undegraded":"2026-02-17T12:05:14.478866+0000","last_fullsized":"2026-02-17T12:05:14.478866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:40:28.089270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031809399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.473914+0000","last_change":"2026-02-17T12:05:14.473914+0000","last_active":"2026-02-17T12:05:14.473914+0000","last_peered":"2026-02-17T12:05:14.473914+0000","last_clean":"2026-02-17T12:05:14.473914+0000","last_became_active":"2026-02-17T12:05:12.528026+0000","last_became_peered":"2026-02-17T12:05:12.528026+0000","last_unstale":"2026-02-17T12:05:14.473914+0000","last_undegraded":"2026-02-17T12:05:14.473914+0000","last_fullsized":"2026-02-17T12:05:14.473914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:38:50.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039251500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.478884+0000","last_change":"2026-02-17T12:05:14.478884+0000","last_active":"2026-02-17T12:05:14.478884+0000","last_peered":"2026-02-17T12:05:14.478884+0000","last_clean":"2026-02-17T12:05:14.478884+0000","last_became_active":"2026-02-17T12:05:12.529966+0000","last_became_peered":"2026-02-17T12:05:12.529966+0000","last_unstale":"2026-02-17T12:05:14.478884+0000","last_undegraded":"2026-02-17T12:05:14.478884+0000","last_fullsized":"2026-02-17T12:05:14.478884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:18:45.016861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033970499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.475335+0000","last_change":"2026-02-17T12:05:14.475335+0000","last_active":"2026-02-17T12:05:14.475335+0000","last_peered":"2026-02-17T12:05:14.475335+0000","last_clean":"2026-02-17T12:05:14.475335+0000","last_became_active":"2026-02-17T12:05:12.276436+0000","last_became_peered":"2026-02-17T12:05:12.276436+0000","last_unstale":"2026-02-17T12:05:14.475335+0000","last_undegraded":"2026-02-17T12:05:14.475335+0000","last_fullsized":"2026-02-17T12:05:14.475335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:54:19.820473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054557800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.742903+0000","last_change":"2026-02-17T12:05:14.742903+0000","last_active":"2026-02-17T12:05:14.742903+0000","last_peered":"2026-02-17T12:05:14.742903+0000","last_clean":"2026-02-17T12:05:14.742903+0000","last_became_active":"2026-02-17T12:05:12.278426+0000","last_became_peered":"2026-02-17T12:05:12.278426+0000","last_unstale":"2026-02-17T12:05:14.742903+0000","last_undegraded":"2026-02-17T12:05:14.742903+0000","last_fullsized":"2026-02-17T12:05:14.742903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:36:27.118344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032063000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.473834+0000","last_change":"2026-02-17T12:05:14.473834+0000","last_active":"2026-02-17T12:05:14.473834+0000","last_peered":"2026-02-17T12:05:14.473834+0000","last_clean":"2026-02-17T12:05:14.473834+0000","last_became_active":"2026-02-17T12:05:12.276579+0000","last_became_peered":"2026-02-17T12:05:12.276579+0000","last_unstale":"2026-02-17T12:05:14.473834+0000","last_undegraded":"2026-02-17T12:05:14.473834+0000","last_fullsized":"2026-02-17T12:05:14.473834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:36:50.953203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311976,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.474924+0000","last_change":"2026-02-17T12:05:14.475054+0000","last_active":"2026-02-17T12:05:14.474924+0000","last_peered":"2026-02-17T12:05:14.474924+0000","last_clean":"2026-02-17T12:05:14.474924+0000","last_became_active":"2026-02-17T12:05:12.276141+0000","last_became_peered":"2026-02-17T12:05:12.276141+0000","last_unstale":"2026-02-17T12:05:14.474924+0000","last_undegraded":"2026-02-17T12:05:14.474924+0000","last_fullsized":"2026-02-17T12:05:14.474924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:51:25.694043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025524199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'112","reported_seq":156,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.473460+0000","last_change":"2026-02-17T12:05:08.039772+0000","last_active":"2026-02-17T12:05:14.473460+0000","last_peered":"2026-02-17T12:05:14.473460+0000","last_clean":"2026-02-17T12:05:14.473460+0000","last_became_active":"2026-02-17T12:05:08.039610+0000","last_became_peered":"2026-02-17T12:05:08.039610+0000","last_unstale":"2026-02-17T12:05:14.473460+0000","last_undegraded":"2026-02-17T12:05:14.473460+0000","last_fullsized":"2026-02-17T12:05:14.473460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_clean_scrub_stamp":"2026-02-17T12:05:06.954552+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:26:36.107316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31296,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340544,"statfs":{"total":96636764160,"available":96604717056,"internally_reserved":0,"allocated":167936,"data_stored":50935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607556,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":163840,"data_stored":50927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607556,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":225280,"data_stored":583979,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607556,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":163840,"data_stored":50927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607556,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31296,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340544,"statfs":{"total":96636764160,"available":96604717056,"internally_reserved":0,"allocated":176128,"data_stored":55070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":217088,"data_stored":579855,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:05:17.570 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:05:17.632 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 10 monclient: get_monmap_and_config 2026-02-17T12:05:17.632 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 10 monclient: build_initial_monmap 2026-02-17T12:05:17.632 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 10 monclient: monmap: 2026-02-17T12:05:17.632 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:17.632 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.632 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:17.632178+0000 2026-02-17T12:05:17.633 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:17.632178+0000 2026-02-17T12:05:17.633 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:17.633 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.633 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:17.633 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:17.633 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:17.633 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:17.633 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:17.633 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.633 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 1 Processor -- start 2026-02-17T12:05:17.634 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 1 -- start start 2026-02-17T12:05:17.634 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 10 monclient: init 2026-02-17T12:05:17.634 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:17.634 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 10 monclient: _add_conns ranks=[0,3,2,1,4] 2026-02-17T12:05:17.634 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc7d00a07d0 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:17.634 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fc7d00a2920 0x7fc7d013b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.634 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 10 monclient(hunting): picked mon.noname-a con 0x7fc7d00a2920 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:17.634 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7d00a2d30 0x7fc7d013def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.634 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 10 monclient(hunting): picked mon.noname-b con 0x7fc7d00a2d30 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:17.634 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7d009d4a0 con 0x7fc7d00a07d0 2026-02-17T12:05:17.634 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.635 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc7d009ed40 con 0x7fc7d00a2920 2026-02-17T12:05:17.635 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.635 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d009ea60 con 0x7fc7d00a2d30 2026-02-17T12:05:17.635 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:17.635 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7d5c11640 10 monclient(hunting): authenticate will time out at 569.307547s 2026-02-17T12:05:17.635 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7cf7fe640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7fc7d00a07d0 0x7fc7d00a2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42424/0 (socket says 10.20.193.77:42424) 2026-02-17T12:05:17.635 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7cf7fe640 1 -- 10.20.193.77:0/804272262 learned_addr learned my addr 10.20.193.77:0/804272262 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:17.635 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 1 --2- 10.20.193.77:0/804272262 >> v2:10.20.193.77:3300/0 conn(0x7fc7d00a2920 0x7fc7d013b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.635 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7cffff640 1 --2- 10.20.193.77:0/804272262 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7d00a2d30 0x7fc7d013def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.635 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 10 monclient(hunting): get_auth_request con 0x7fc7d00a2920 auth_method 0 2026-02-17T12:05:17.636 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.636 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.636 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.636 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7cffff640 10 monclient(hunting): get_auth_request con 0x7fc7d00a2d30 auth_method 0 2026-02-17T12:05:17.636 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.636 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7cffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.636 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.636 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.636 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.636 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.636 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.636 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.637 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.637 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 10 monclient(hunting): handle_auth_done global_id 4308 payload 274 2026-02-17T12:05:17.637 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 1 -- 10.20.193.77:0/804272262 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7d00a2d30 msgr2=0x7fc7d013def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:17.637 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 1 --2- 10.20.193.77:0/804272262 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7d00a2d30 0x7fc7d013def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.637 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 1 -- 10.20.193.77:0/804272262 >> v1:10.20.193.77:6789/0 conn(0x7fc7d00a07d0 legacy=0x7fc7d00a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:17.637 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 10 monclient: _finish_hunting 0 2026-02-17T12:05:17.637 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 1 monclient: found mon.noname-a 2026-02-17T12:05:17.637 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:17.637 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.637 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.626+0000 7fc7ceffd640 1 -- 10.20.193.77:0/804272262 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d009d720 con 0x7fc7d00a2920 2026-02-17T12:05:17.643 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ceffd640 1 -- 10.20.193.77:0/804272262 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7d00a2920 msgr2=0x7fc7d013b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:17.643 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ceffd640 1 --2- 10.20.193.77:0/804272262 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7d00a2920 0x7fc7d013b9a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00098c0 tx=0x7fc7c001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4500191e7ee32bb1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.643 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ce7fc640 1 -- 10.20.193.77:0/804272262 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00b0070 con 0x7fc7d00a2920 2026-02-17T12:05:17.644 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.644 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ce7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:17.644 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ce7fc640 10 monclient: dump: 2026-02-17T12:05:17.644 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.644 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.644 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.644 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.644 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.644 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.644 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.644 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.644 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.645 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.645 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ce7fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:17.645 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ce7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:17.645 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:17.645 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ce7fc640 1 -- 10.20.193.77:0/804272262 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c00ab600 con 0x7fc7d00a2920 2026-02-17T12:05:17.645 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ce7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:17.645 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ce7fc640 1 -- 10.20.193.77:0/804272262 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00ab9d0 con 0x7fc7d00a2920 2026-02-17T12:05:17.645 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.645 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ce7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:17.645 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7ce7fc640 10 monclient: dump: 2026-02-17T12:05:17.645 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.645 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.646 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.646 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.646 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.646 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.646 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.646 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.646 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.646 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.646 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7d5c11640 5 monclient: authenticate success, global_id 4308 2026-02-17T12:05:17.646 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7d5c11640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:17.646 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7d5c11640 4 set_mon_vals no callback set 2026-02-17T12:05:17.646 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7d5c11640 10 monclient: shutdown 2026-02-17T12:05:17.647 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7d5c11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:17.647 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7d5c11640 1 -- 10.20.193.77:0/804272262 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7d00a2920 msgr2=0x7fc7d013b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.647 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7d5c11640 1 --2- 10.20.193.77:0/804272262 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7d00a2920 0x7fc7d013b9a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00098c0 tx=0x7fc7c001c480 comp rx=0 tx=0).stop 2026-02-17T12:05:17.647 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7d5c11640 1 -- 10.20.193.77:0/804272262 shutdown_connections 2026-02-17T12:05:17.647 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7d5c11640 1 --2- 10.20.193.77:0/804272262 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7d00a2d30 0x7fc7d013def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.647 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7d5c11640 1 --2- 10.20.193.77:0/804272262 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7d00a2920 0x7fc7d013b9a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.647 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7d5c11640 1 -- 10.20.193.77:0/804272262 >> 10.20.193.77:0/804272262 conn(0x7fc7d00a73c0 msgr2=0x7fc7d00a3300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:17.647 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7d5c11640 1 -- 10.20.193.77:0/804272262 shutdown_connections 2026-02-17T12:05:17.647 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.630+0000 7fc7d5c11640 1 -- 10.20.193.77:0/804272262 wait complete. 2026-02-17T12:05:17.647 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient: build_initial_monmap 2026-02-17T12:05:17.647 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient: monmap: 2026-02-17T12:05:17.647 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:17.648 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:17.648 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:17.648 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:17.648 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:17.648 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.648 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:17.648 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:17.648 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:17.648 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.648 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 1 Processor -- start 2026-02-17T12:05:17.648 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 1 -- start start 2026-02-17T12:05:17.648 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient: init 2026-02-17T12:05:17.649 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:17.649 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:05:17.649 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7d00a07d0 0x7fc7d0097d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.649 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient(hunting): picked mon.noname-a con 0x7fc7d00a07d0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:17.649 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7d00a2920 0x7fc7d0095000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.649 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient(hunting): picked mon.noname-c con 0x7fc7d00a2920 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:17.649 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7d00a2d30 0x7fc7d0095540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.649 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient(hunting): picked mon.noname-b con 0x7fc7d00a2d30 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:17.649 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.649 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d009f8a0 con 0x7fc7d00a07d0 2026-02-17T12:05:17.649 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.649 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d009f720 con 0x7fc7d00a2d30 2026-02-17T12:05:17.649 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.650 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d0140c50 con 0x7fc7d00a2920 2026-02-17T12:05:17.650 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:17.650 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient(hunting): authenticate will time out at 569.312849s 2026-02-17T12:05:17.650 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7d00a07d0 0x7fc7d0097d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.650 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7d00a07d0 0x7fc7d0097d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44580/0 (socket says 10.20.193.77:44580) 2026-02-17T12:05:17.650 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 1 -- 10.20.193.77:0/225453492 learned_addr learned my addr 10.20.193.77:0/225453492 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:17.650 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 10 monclient(hunting): get_auth_request con 0x7fc7d00a07d0 auth_method 0 2026-02-17T12:05:17.650 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.650 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.650 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.650 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7ceffd640 1 --2- 10.20.193.77:0/225453492 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7d00a2920 0x7fc7d0095000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.650 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7ceffd640 10 monclient(hunting): get_auth_request con 0x7fc7d00a2920 auth_method 0 2026-02-17T12:05:17.651 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7ceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.651 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.651 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.651 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.651 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.651 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.651 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7ceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.651 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7ceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.651 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7ceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.651 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 10 monclient(hunting): handle_auth_done global_id 4311 payload 824 2026-02-17T12:05:17.651 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 1 -- 10.20.193.77:0/225453492 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7d00a2920 msgr2=0x7fc7d0095000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.651 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 1 --2- 10.20.193.77:0/225453492 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7d00a2920 0x7fc7d0095000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.651 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 1 -- 10.20.193.77:0/225453492 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7d00a2d30 msgr2=0x7fc7d0095540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 1 --2- 10.20.193.77:0/225453492 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7d00a2d30 0x7fc7d0095540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:17.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 1 monclient: found mon.noname-a 2026-02-17T12:05:17.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:17.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 1 -- 10.20.193.77:0/225453492 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d0098290 con 0x7fc7d00a07d0 2026-02-17T12:05:17.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 1 -- 10.20.193.77:0/225453492 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7d00a07d0 msgr2=0x7fc7d0097d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:17.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cf7fe640 1 --2- 10.20.193.77:0/225453492 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7d00a07d0 0x7fc7d0097d50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00b530 tx=0x7fc7bc00b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7abfff640 1 -- 10.20.193.77:0/225453492 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc014070 con 0x7fc7d00a07d0 2026-02-17T12:05:17.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7abfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:17.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7abfff640 10 monclient: dump: 2026-02-17T12:05:17.653 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.653 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.653 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.653 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.653 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.653 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.653 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.653 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.653 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.653 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.653 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7abfff640 10 monclient: _finish_auth 0 2026-02-17T12:05:17.653 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7abfff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:17.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:17.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7abfff640 1 -- 10.20.193.77:0/225453492 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc010820 con 0x7fc7d00a07d0 2026-02-17T12:05:17.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7abfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:17.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7abfff640 1 -- 10.20.193.77:0/225453492 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc010c10 con 0x7fc7d00a07d0 2026-02-17T12:05:17.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:17.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7abfff640 10 monclient: dump: 2026-02-17T12:05:17.654 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.654 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.654 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.654 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.654 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.654 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.655 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.655 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.655 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.655 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7cdffb640 4 set_mon_vals no callback set 2026-02-17T12:05:17.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 5 monclient: authenticate success, global_id 4311 2026-02-17T12:05:17.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient: _renew_subs 2026-02-17T12:05:17.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 1 -- 10.20.193.77:0/225453492 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d0098f90 con 0x7fc7d00a07d0 2026-02-17T12:05:17.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient: _renew_subs 2026-02-17T12:05:17.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.634+0000 7fc7d5c11640 1 -- 10.20.193.77:0/225453492 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d009d9f0 con 0x7fc7d00a07d0 2026-02-17T12:05:17.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.638+0000 7fc7d5c11640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.638+0000 7fc7d5c11640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.638+0000 7fc7d5c11640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:17.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.638+0000 7fc7d5c11640 1 -- 10.20.193.77:0/225453492 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d00a2210 con 0x7fc7d00a07d0 2026-02-17T12:05:17.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.638+0000 7fc7abfff640 1 -- 10.20.193.77:0/225453492 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fc7bc019450 con 0x7fc7d00a07d0 2026-02-17T12:05:17.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.638+0000 7fc7abfff640 1 --2- 10.20.193.77:0/225453492 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc7a003a170 0x7fc7a003c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.638+0000 7fc7abfff640 1 -- 10.20.193.77:0/225453492 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7fc7bc04d650 con 0x7fc7d00a07d0 2026-02-17T12:05:17.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.638+0000 7fc7ceffd640 1 --2- 10.20.193.77:0/225453492 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc7a003a170 0x7fc7a003c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.638+0000 7fc7ceffd640 10 monclient: get_auth_request con 0x7fc7a003a170 auth_method 0 2026-02-17T12:05:17.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.638+0000 7fc7ceffd640 1 --2- 10.20.193.77:0/225453492 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc7a003a170 0x7fc7a003c630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00ab000 tx=0x7fc7c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.638+0000 7fc7abfff640 1 -- 10.20.193.77:0/225453492 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7fc7bc01e030 con 0x7fc7d00a07d0 2026-02-17T12:05:17.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.638+0000 7fc7abfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.657 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.638+0000 7fc7abfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:17.716 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 1 -- 10.20.193.77:0/225453492 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7d00008e0 con 0x7fc7a003a170 2026-02-17T12:05:17.717 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7abfff640 1 -- 10.20.193.77:0/225453492 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34183 (secure 0 0 0) 0x7fc7d00008e0 con 0x7fc7a003a170 2026-02-17T12:05:17.718 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:05:17.719 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T12:05:17.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 1 -- 10.20.193.77:0/225453492 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc7a003a170 msgr2=0x7fc7a003c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 1 --2- 10.20.193.77:0/225453492 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc7a003a170 0x7fc7a003c630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00ab000 tx=0x7fc7c0008040 comp rx=0 tx=0).stop 2026-02-17T12:05:17.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 10 monclient: shutdown 2026-02-17T12:05:17.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:17.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 1 -- 10.20.193.77:0/225453492 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7d00a07d0 msgr2=0x7fc7d0097d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 1 --2- 10.20.193.77:0/225453492 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7d00a07d0 0x7fc7d0097d50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00b530 tx=0x7fc7bc00b9f0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 1 -- 10.20.193.77:0/225453492 shutdown_connections 2026-02-17T12:05:17.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 1 --2- 10.20.193.77:0/225453492 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc7a003a170 0x7fc7a003c630 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 1 --2- 10.20.193.77:0/225453492 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc7d00a2d30 0x7fc7d0095540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 1 --2- 10.20.193.77:0/225453492 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc7d00a2920 0x7fc7d0095000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 1 --2- 10.20.193.77:0/225453492 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc7d00a07d0 0x7fc7d0097d50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 1 -- 10.20.193.77:0/225453492 >> 10.20.193.77:0/225453492 conn(0x7fc7d00a73c0 msgr2=0x7fc7d0073f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:17.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 1 -- 10.20.193.77:0/225453492 shutdown_connections 2026-02-17T12:05:17.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.714+0000 7fc7d5c11640 1 -- 10.20.193.77:0/225453492 wait complete. 2026-02-17T12:05:17.728 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-17T12:05:16.269218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":183680,"kb_used_data":1088,"kb_used_omap":9,"kb_used_meta":182454,"kb_avail":566047360,"statfs":{"total":579820584960,"available":579632496640,"internally_reserved":0,"allocated":1114112,"data_stored":1371693,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":186833575},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.999164"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.474034+0000","last_change":"2026-02-17T12:05:14.474034+0000","last_active":"2026-02-17T12:05:14.474034+0000","last_peered":"2026-02-17T12:05:14.474034+0000","last_clean":"2026-02-17T12:05:14.474034+0000","last_became_active":"2026-02-17T12:05:12.276658+0000","last_became_peered":"2026-02-17T12:05:12.276658+0000","last_unstale":"2026-02-17T12:05:14.474034+0000","last_undegraded":"2026-02-17T12:05:14.474034+0000","last_fullsized":"2026-02-17T12:05:14.474034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:42:47.843930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048223100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.478866+0000","last_change":"2026-02-17T12:05:14.478866+0000","last_active":"2026-02-17T12:05:14.478866+0000","last_peered":"2026-02-17T12:05:14.478866+0000","last_clean":"2026-02-17T12:05:14.478866+0000","last_became_active":"2026-02-17T12:05:12.278326+0000","last_became_peered":"2026-02-17T12:05:12.278326+0000","last_unstale":"2026-02-17T12:05:14.478866+0000","last_undegraded":"2026-02-17T12:05:14.478866+0000","last_fullsized":"2026-02-17T12:05:14.478866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:40:28.089270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031809399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.473914+0000","last_change":"2026-02-17T12:05:14.473914+0000","last_active":"2026-02-17T12:05:14.473914+0000","last_peered":"2026-02-17T12:05:14.473914+0000","last_clean":"2026-02-17T12:05:14.473914+0000","last_became_active":"2026-02-17T12:05:12.528026+0000","last_became_peered":"2026-02-17T12:05:12.528026+0000","last_unstale":"2026-02-17T12:05:14.473914+0000","last_undegraded":"2026-02-17T12:05:14.473914+0000","last_fullsized":"2026-02-17T12:05:14.473914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:38:50.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039251500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.478884+0000","last_change":"2026-02-17T12:05:14.478884+0000","last_active":"2026-02-17T12:05:14.478884+0000","last_peered":"2026-02-17T12:05:14.478884+0000","last_clean":"2026-02-17T12:05:14.478884+0000","last_became_active":"2026-02-17T12:05:12.529966+0000","last_became_peered":"2026-02-17T12:05:12.529966+0000","last_unstale":"2026-02-17T12:05:14.478884+0000","last_undegraded":"2026-02-17T12:05:14.478884+0000","last_fullsized":"2026-02-17T12:05:14.478884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:18:45.016861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033970499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.475335+0000","last_change":"2026-02-17T12:05:14.475335+0000","last_active":"2026-02-17T12:05:14.475335+0000","last_peered":"2026-02-17T12:05:14.475335+0000","last_clean":"2026-02-17T12:05:14.475335+0000","last_became_active":"2026-02-17T12:05:12.276436+0000","last_became_peered":"2026-02-17T12:05:12.276436+0000","last_unstale":"2026-02-17T12:05:14.475335+0000","last_undegraded":"2026-02-17T12:05:14.475335+0000","last_fullsized":"2026-02-17T12:05:14.475335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:54:19.820473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054557800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.742903+0000","last_change":"2026-02-17T12:05:14.742903+0000","last_active":"2026-02-17T12:05:14.742903+0000","last_peered":"2026-02-17T12:05:14.742903+0000","last_clean":"2026-02-17T12:05:14.742903+0000","last_became_active":"2026-02-17T12:05:12.278426+0000","last_became_peered":"2026-02-17T12:05:12.278426+0000","last_unstale":"2026-02-17T12:05:14.742903+0000","last_undegraded":"2026-02-17T12:05:14.742903+0000","last_fullsized":"2026-02-17T12:05:14.742903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:36:27.118344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032063000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.473834+0000","last_change":"2026-02-17T12:05:14.473834+0000","last_active":"2026-02-17T12:05:14.473834+0000","last_peered":"2026-02-17T12:05:14.473834+0000","last_clean":"2026-02-17T12:05:14.473834+0000","last_became_active":"2026-02-17T12:05:12.276579+0000","last_became_peered":"2026-02-17T12:05:12.276579+0000","last_unstale":"2026-02-17T12:05:14.473834+0000","last_undegraded":"2026-02-17T12:05:14.473834+0000","last_fullsized":"2026-02-17T12:05:14.473834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:36:50.953203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311976,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.474924+0000","last_change":"2026-02-17T12:05:14.475054+0000","last_active":"2026-02-17T12:05:14.474924+0000","last_peered":"2026-02-17T12:05:14.474924+0000","last_clean":"2026-02-17T12:05:14.474924+0000","last_became_active":"2026-02-17T12:05:12.276141+0000","last_became_peered":"2026-02-17T12:05:12.276141+0000","last_unstale":"2026-02-17T12:05:14.474924+0000","last_undegraded":"2026-02-17T12:05:14.474924+0000","last_fullsized":"2026-02-17T12:05:14.474924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:51:25.694043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025524199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'112","reported_seq":156,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.473460+0000","last_change":"2026-02-17T12:05:08.039772+0000","last_active":"2026-02-17T12:05:14.473460+0000","last_peered":"2026-02-17T12:05:14.473460+0000","last_clean":"2026-02-17T12:05:14.473460+0000","last_became_active":"2026-02-17T12:05:08.039610+0000","last_became_peered":"2026-02-17T12:05:08.039610+0000","last_unstale":"2026-02-17T12:05:14.473460+0000","last_undegraded":"2026-02-17T12:05:14.473460+0000","last_fullsized":"2026-02-17T12:05:14.473460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_clean_scrub_stamp":"2026-02-17T12:05:06.954552+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:26:36.107316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31296,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340544,"statfs":{"total":96636764160,"available":96604717056,"internally_reserved":0,"allocated":167936,"data_stored":50935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607556,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":163840,"data_stored":50927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607556,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":225280,"data_stored":583979,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607556,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":163840,"data_stored":50927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607556,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31296,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340544,"statfs":{"total":96636764160,"available":96604717056,"internally_reserved":0,"allocated":176128,"data_stored":55070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":217088,"data_stored":579855,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:05:17.729 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T12:05:17.729 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T12:05:17.729 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T12:05:17.730 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:05:17.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 10 monclient: get_monmap_and_config 2026-02-17T12:05:17.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 10 monclient: build_initial_monmap 2026-02-17T12:05:17.792 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 10 monclient: monmap: 2026-02-17T12:05:17.792 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:17.792 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.792 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:17.795036+0000 2026-02-17T12:05:17.792 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:17.795036+0000 2026-02-17T12:05:17.792 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:17.792 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.793 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:17.793 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:17.793 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:17.793 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:17.793 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:17.793 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 1 Processor -- start 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 1 -- start start 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 10 monclient: init 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 10 monclient: _add_conns ranks=[2,4,0,1,3] 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd3180a3120 0x7fd3180a3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 10 monclient(hunting): picked mon.noname-b con 0x7fd3180a3120 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fd31806f7c0 0x7fd3180a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 10 monclient(hunting): picked mon.noname-c con 0x7fd31806f7c0 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd3181384d0 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3180a4b50 con 0x7fd3181384d0 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd31806f350 con 0x7fd31806f7c0 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd3180a3f80 con 0x7fd3180a3120 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31e7a4640 10 monclient(hunting): authenticate will time out at 569.470698s 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd3180a3120 0x7fd3180a3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31cd1a640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7fd3181384d0 0x7fd318138900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42430/0 (socket says 10.20.193.77:42430) 2026-02-17T12:05:17.794 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd31cd1a640 1 -- 10.20.193.77:0/4138043940 learned_addr learned my addr 10.20.193.77:0/4138043940 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 10 monclient(hunting): get_auth_request con 0x7fd3180a3120 auth_method 0 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd3177fe640 1 --2- 10.20.193.77:0/4138043940 >> v2:10.20.193.119:3300/0 conn(0x7fd31806f7c0 0x7fd3180a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd3177fe640 10 monclient(hunting): get_auth_request con 0x7fd31806f7c0 auth_method 0 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd3177fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd3177fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd3177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd3177fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd3177fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd3177fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 10 monclient(hunting): handle_auth_done global_id 4310 payload 274 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 1 -- 10.20.193.77:0/4138043940 >> v2:10.20.193.119:3300/0 conn(0x7fd31806f7c0 msgr2=0x7fd3180a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 1 --2- 10.20.193.77:0/4138043940 >> v2:10.20.193.119:3300/0 conn(0x7fd31806f7c0 0x7fd3180a3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 1 -- 10.20.193.77:0/4138043940 >> v1:10.20.193.77:6789/0 conn(0x7fd3181384d0 legacy=0x7fd318138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 1 monclient: found mon.noname-b 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:17.795 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.790+0000 7fd317fff640 1 -- 10.20.193.77:0/4138043940 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31806ea20 con 0x7fd3180a3120 2026-02-17T12:05:17.796 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd317fff640 1 -- 10.20.193.77:0/4138043940 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd3180a3120 msgr2=0x7fd3180a3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:17.796 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd317fff640 1 --2- 10.20.193.77:0/4138043940 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd3180a3120 0x7fd3180a3500 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd3040098c0 tx=0x7fd30401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd40c5cdd9f466dd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd316ffd640 1 -- 10.20.193.77:0/4138043940 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3040ab620 con 0x7fd3180a3120 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd316ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd316ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd316ffd640 10 monclient: dump: 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd316ffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd316ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd316ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd316ffd640 1 -- 10.20.193.77:0/4138043940 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3040b0070 con 0x7fd3180a3120 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd316ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:17.797 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd316ffd640 1 -- 10.20.193.77:0/4138043940 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3040ab9e0 con 0x7fd3180a3120 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd316ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd316ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd316ffd640 10 monclient: dump: 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 5 monclient: authenticate success, global_id 4310 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:17.798 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 4 set_mon_vals no callback set 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 10 monclient: shutdown 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 1 -- 10.20.193.77:0/4138043940 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd3180a3120 msgr2=0x7fd3180a3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 1 --2- 10.20.193.77:0/4138043940 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd3180a3120 0x7fd3180a3500 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd3040098c0 tx=0x7fd30401c480 comp rx=0 tx=0).stop 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 1 -- 10.20.193.77:0/4138043940 shutdown_connections 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 1 --2- 10.20.193.77:0/4138043940 >> v2:10.20.193.119:3300/0 conn(0x7fd31806f7c0 0x7fd3180a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 1 --2- 10.20.193.77:0/4138043940 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd3180a3120 0x7fd3180a3500 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 1 -- 10.20.193.77:0/4138043940 >> 10.20.193.77:0/4138043940 conn(0x7fd3180a8820 msgr2=0x7fd3180a8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 1 -- 10.20.193.77:0/4138043940 shutdown_connections 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 1 -- 10.20.193.77:0/4138043940 wait complete. 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 10 monclient: build_initial_monmap 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 10 monclient: monmap: 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 1 Processor -- start 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 1 -- start start 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.794+0000 7fd31e7a4640 10 monclient: init 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:17.800 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd31806f7c0 0x7fd3181d2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient(hunting): picked mon.noname-c con 0x7fd31806f7c0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd3180a3120 0x7fd3181d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient(hunting): picked mon.noname-b con 0x7fd3180a3120 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3181384d0 0x7fd3181d30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient(hunting): picked mon.noname-a con 0x7fd3181384d0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd31806dfa0 con 0x7fd3181384d0 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd31806de20 con 0x7fd3180a3120 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd318143160 con 0x7fd31806f7c0 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient(hunting): authenticate will time out at 569.476118s 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd31806f7c0 0x7fd3181d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31cd1a640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3181384d0 0x7fd3181d30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd31806f7c0 0x7fd3181d2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50930/0 (socket says 10.20.193.77:50930) 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 1 -- 10.20.193.77:0/3116470338 learned_addr learned my addr 10.20.193.77:0/3116470338 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 10 monclient(hunting): get_auth_request con 0x7fd31806f7c0 auth_method 0 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31cd1a640 10 monclient(hunting): get_auth_request con 0x7fd3181384d0 auth_method 0 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31cd1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31cd1a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31cd1a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31cd1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31cd1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:17.801 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31cd1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd3177fe640 1 --2- 10.20.193.77:0/3116470338 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd3180a3120 0x7fd3181d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd3177fe640 10 monclient(hunting): get_auth_request con 0x7fd3180a3120 auth_method 0 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd3177fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd3177fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd3177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 10 monclient(hunting): handle_auth_done global_id 4313 payload 824 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 1 -- 10.20.193.77:0/3116470338 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd3180a3120 msgr2=0x7fd3181d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 1 --2- 10.20.193.77:0/3116470338 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd3180a3120 0x7fd3181d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 1 -- 10.20.193.77:0/3116470338 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3181384d0 msgr2=0x7fd3181d30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 1 --2- 10.20.193.77:0/3116470338 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3181384d0 0x7fd3181d30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 1 monclient: found mon.noname-c 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 1 -- 10.20.193.77:0/3116470338 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31813f610 con 0x7fd31806f7c0 2026-02-17T12:05:17.802 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31cd1a640 1 --2- 10.20.193.77:0/3116470338 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3181384d0 0x7fd3181d30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 1 -- 10.20.193.77:0/3116470338 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd31806f7c0 msgr2=0x7fd3181d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd317fff640 1 --2- 10.20.193.77:0/3116470338 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd31806f7c0 0x7fd3181d2660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd3040ad040 tx=0x7fd30401acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 1 -- 10.20.193.77:0/3116470338 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3040bf410 con 0x7fd31806f7c0 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 10 monclient: dump: 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 10 monclient: _finish_auth 0 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:05:17.803 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 1 -- 10.20.193.77:0/3116470338 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3040bf5d0 con 0x7fd31806f7c0 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 1 -- 10.20.193.77:0/3116470338 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3040bf9c0 con 0x7fd31806f7c0 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 10 monclient: dump: 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd3167fc640 4 set_mon_vals no callback set 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 5 monclient: authenticate success, global_id 4313 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient: _renew_subs 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 1 -- 10.20.193.77:0/3116470338 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31813f8f0 con 0x7fd31806f7c0 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient: _renew_subs 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 1 -- 10.20.193.77:0/3116470338 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31813f330 con 0x7fd31806f7c0 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd31e7a4640 1 -- 10.20.193.77:0/3116470338 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd318138900 con 0x7fd31806f7c0 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 1 -- 10.20.193.77:0/3116470338 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fd3040c7030 con 0x7fd31806f7c0 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 1 --2- 10.20.193.77:0/3116470338 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd2e803a170 0x7fd2e803c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:17.804 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd314ff9640 1 -- 10.20.193.77:0/3116470338 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7fd3040e7ca0 con 0x7fd31806f7c0 2026-02-17T12:05:17.805 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd3177fe640 1 --2- 10.20.193.77:0/3116470338 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd2e803a170 0x7fd2e803c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:17.805 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.798+0000 7fd3177fe640 10 monclient: get_auth_request con 0x7fd2e803a170 auth_method 0 2026-02-17T12:05:17.805 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.802+0000 7fd314ff9640 1 -- 10.20.193.77:0/3116470338 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7fd304016190 con 0x7fd31806f7c0 2026-02-17T12:05:17.805 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.802+0000 7fd314ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:17.805 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.802+0000 7fd314ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:17.805 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.802+0000 7fd3177fe640 1 --2- 10.20.193.77:0/3116470338 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd2e803a170 0x7fd2e803c630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd31813e980 tx=0x7fd308008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:17.894 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.890+0000 7fd31e7a4640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T12:05:17.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.890+0000 7fd31e7a4640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:05:17.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.890+0000 7fd31e7a4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:17.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.890+0000 7fd31e7a4640 1 -- 10.20.193.77:0/3116470338 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd31813dee0 con 0x7fd31806f7c0 2026-02-17T12:05:17.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.890+0000 7fd314ff9640 1 -- 10.20.193.77:0/3116470338 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd3040bedf0 con 0x7fd31806f7c0 2026-02-17T12:05:17.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.890+0000 7fd314ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T12:05:17.895 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.890+0000 7fd314ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:17.896 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:05:17.896 INFO:teuthology.orchestra.run.trial077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T12:05:17.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.894+0000 7fd31e7a4640 1 -- 10.20.193.77:0/3116470338 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd2e803a170 msgr2=0x7fd2e803c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.894+0000 7fd31e7a4640 1 --2- 10.20.193.77:0/3116470338 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd2e803a170 0x7fd2e803c630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd31813e980 tx=0x7fd308008040 comp rx=0 tx=0).stop 2026-02-17T12:05:17.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.894+0000 7fd31e7a4640 10 monclient: shutdown 2026-02-17T12:05:17.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.894+0000 7fd31e7a4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:17.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.894+0000 7fd31e7a4640 1 -- 10.20.193.77:0/3116470338 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd31806f7c0 msgr2=0x7fd3181d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:17.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.894+0000 7fd31e7a4640 1 --2- 10.20.193.77:0/3116470338 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd31806f7c0 0x7fd3181d2660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd3040ad040 tx=0x7fd30401acc0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.897 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.894+0000 7fd31e7a4640 1 -- 10.20.193.77:0/3116470338 shutdown_connections 2026-02-17T12:05:17.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.894+0000 7fd31e7a4640 1 --2- 10.20.193.77:0/3116470338 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd2e803a170 0x7fd2e803c630 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.894+0000 7fd31e7a4640 1 --2- 10.20.193.77:0/3116470338 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3181384d0 0x7fd3181d30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.894+0000 7fd31e7a4640 1 --2- 10.20.193.77:0/3116470338 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd3180a3120 0x7fd3181d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.894+0000 7fd31e7a4640 1 --2- 10.20.193.77:0/3116470338 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd31806f7c0 0x7fd3181d2660 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:17.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.894+0000 7fd31e7a4640 1 -- 10.20.193.77:0/3116470338 >> 10.20.193.77:0/3116470338 conn(0x7fd3180a8820 msgr2=0x7fd3180a1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:17.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.894+0000 7fd31e7a4640 1 -- 10.20.193.77:0/3116470338 shutdown_connections 2026-02-17T12:05:17.898 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.894+0000 7fd31e7a4640 1 -- 10.20.193.77:0/3116470338 wait complete. 2026-02-17T12:05:17.907 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T12:05:17.907 INFO:teuthology.run_tasks:Running task mon_thrash... 2026-02-17T12:05:17.930 INFO:tasks.mon_thrash:Beginning mon_thrash... 2026-02-17T12:05:17.931 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T12:05:18.001 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.994+0000 7fe60888b640 10 monclient: get_monmap_and_config 2026-02-17T12:05:18.001 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.994+0000 7fe60888b640 10 monclient: build_initial_monmap 2026-02-17T12:05:18.001 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.994+0000 7fe60888b640 10 monclient: monmap: 2026-02-17T12:05:18.001 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:18.001 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.002 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:18.000866+0000 2026-02-17T12:05:18.002 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:18.000866+0000 2026-02-17T12:05:18.002 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:18.002 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.002 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:18.002 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:18.002 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:18.002 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:18.002 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:18.002 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.003 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.994+0000 7fe60888b640 1 Processor -- start 2026-02-17T12:05:18.003 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.994+0000 7fe60888b640 1 -- start start 2026-02-17T12:05:18.003 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.994+0000 7fe60888b640 10 monclient: init 2026-02-17T12:05:18.003 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:18.003 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 10 monclient: _add_conns ranks=[4,2,3,0,1] 2026-02-17T12:05:18.003 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fe60409be20 0x7fe604134e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.003 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 10 monclient(hunting): picked mon.noname-c con 0x7fe60409be20 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:18.003 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe6040a4c20 0x7fe6041380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.003 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 10 monclient(hunting): picked mon.noname-b con 0x7fe6040a4c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:18.004 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fe6040a5040 0x7fe604138630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.004 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 10 monclient(hunting): picked mon.noname-a con 0x7fe6040a5040 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:18.004 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.004 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe60409c200 con 0x7fe6040a5040 2026-02-17T12:05:18.004 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.004 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe60409cdf0 con 0x7fe60409be20 2026-02-17T12:05:18.004 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.004 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe60409d0d0 con 0x7fe6040a4c20 2026-02-17T12:05:18.004 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:18.004 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe60888b640 10 monclient(hunting): authenticate will time out at 569.676278s 2026-02-17T12:05:18.005 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe6040a4c20 0x7fe6041380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.005 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602d76640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fe6040a5040 0x7fe604138630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.005 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe6040a4c20 0x7fe6041380f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50944/0 (socket says 10.20.193.77:50944) 2026-02-17T12:05:18.005 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 1 -- 10.20.193.77:0/3503985724 learned_addr learned my addr 10.20.193.77:0/3503985724 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:18.005 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 10 monclient(hunting): get_auth_request con 0x7fe6040a4c20 auth_method 0 2026-02-17T12:05:18.005 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.005 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.005 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.005 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602d76640 10 monclient(hunting): get_auth_request con 0x7fe6040a5040 auth_method 0 2026-02-17T12:05:18.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602575640 1 --2- 10.20.193.77:0/3503985724 >> v2:10.20.193.119:3300/0 conn(0x7fe60409be20 0x7fe604134e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602575640 10 monclient(hunting): get_auth_request con 0x7fe60409be20 auth_method 0 2026-02-17T12:05:18.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.007 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.007 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.007 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.007 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.007 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.007 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.007 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 10 monclient(hunting): handle_auth_done global_id 4316 payload 274 2026-02-17T12:05:18.007 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 1 -- 10.20.193.77:0/3503985724 >> v2:10.20.193.119:3300/0 conn(0x7fe60409be20 msgr2=0x7fe604134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:18.007 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 1 --2- 10.20.193.77:0/3503985724 >> v2:10.20.193.119:3300/0 conn(0x7fe60409be20 0x7fe604134e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.007 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 1 -- 10.20.193.77:0/3503985724 >> v2:10.20.193.77:3300/0 conn(0x7fe6040a5040 msgr2=0x7fe604138630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:18.007 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 1 --2- 10.20.193.77:0/3503985724 >> v2:10.20.193.77:3300/0 conn(0x7fe6040a5040 0x7fe604138630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.008 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 10 monclient: _finish_hunting 0 2026-02-17T12:05:18.008 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 1 monclient: found mon.noname-b 2026-02-17T12:05:18.008 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:18.008 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.008 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe601d74640 1 -- 10.20.193.77:0/3503985724 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60409d3b0 con 0x7fe6040a4c20 2026-02-17T12:05:18.008 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:17.998+0000 7fe602d76640 1 --2- 10.20.193.77:0/3503985724 >> v2:10.20.193.77:3300/0 conn(0x7fe6040a5040 0x7fe604138630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:18.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601d74640 1 -- 10.20.193.77:0/3503985724 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe6040a4c20 msgr2=0x7fe6041380f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:18.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601d74640 1 --2- 10.20.193.77:0/3503985724 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe6040a4c20 0x7fe6041380f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe6040750e0 tx=0x7fe5ec01c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74b22ddb68fa53e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601573640 1 -- 10.20.193.77:0/3503985724 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0b1070 con 0x7fe6040a4c20 2026-02-17T12:05:18.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:18.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601573640 10 monclient: dump: 2026-02-17T12:05:18.015 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.016 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.016 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.016 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.016 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.016 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.016 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.016 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.016 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.016 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.016 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601573640 10 monclient: _finish_auth 0 2026-02-17T12:05:18.016 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601573640 10 monclient: _check_auth_tickets 2026-02-17T12:05:18.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:18.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601573640 1 -- 10.20.193.77:0/3503985724 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5ec004230 con 0x7fe6040a4c20 2026-02-17T12:05:18.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:18.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601573640 1 -- 10.20.193.77:0/3503985724 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0a8050 con 0x7fe6040a4c20 2026-02-17T12:05:18.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 5 monclient: authenticate success, global_id 4316 2026-02-17T12:05:18.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:18.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 4 set_mon_vals no callback set 2026-02-17T12:05:18.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:18.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601573640 10 monclient: dump: 2026-02-17T12:05:18.017 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.018 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.018 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.018 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.018 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.018 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.018 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.018 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.018 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.018 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.018 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient: shutdown 2026-02-17T12:05:18.018 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:18.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 -- 10.20.193.77:0/3503985724 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe6040a4c20 msgr2=0x7fe6041380f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 --2- 10.20.193.77:0/3503985724 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe6040a4c20 0x7fe6041380f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe6040750e0 tx=0x7fe5ec01c500 comp rx=0 tx=0).stop 2026-02-17T12:05:18.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 -- 10.20.193.77:0/3503985724 shutdown_connections 2026-02-17T12:05:18.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 --2- 10.20.193.77:0/3503985724 >> v2:10.20.193.77:3300/0 conn(0x7fe6040a5040 0x7fe604138630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 --2- 10.20.193.77:0/3503985724 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe6040a4c20 0x7fe6041380f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 --2- 10.20.193.77:0/3503985724 >> v2:10.20.193.119:3300/0 conn(0x7fe60409be20 0x7fe604134e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 -- 10.20.193.77:0/3503985724 >> 10.20.193.77:0/3503985724 conn(0x7fe604074ba0 msgr2=0x7fe6040aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:18.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 -- 10.20.193.77:0/3503985724 shutdown_connections 2026-02-17T12:05:18.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 -- 10.20.193.77:0/3503985724 wait complete. 2026-02-17T12:05:18.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient: build_initial_monmap 2026-02-17T12:05:18.020 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient: monmap: 2026-02-17T12:05:18.020 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:18.020 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:18.020 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:18.020 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:18.020 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:18.020 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.020 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:18.020 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:18.020 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:18.020 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 Processor -- start 2026-02-17T12:05:18.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 -- start start 2026-02-17T12:05:18.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient: init 2026-02-17T12:05:18.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:18.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:05:18.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe60409be20 0x7fe6041d2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient(hunting): picked mon.noname-c con 0x7fe60409be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:18.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe6040a4c20 0x7fe6040a3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient(hunting): picked mon.noname-a con 0x7fe6040a4c20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:18.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe6040a5040 0x7fe6040a4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient(hunting): picked mon.noname-b con 0x7fe6040a5040 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:18.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe604138f80 con 0x7fe6040a4c20 2026-02-17T12:05:18.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe604141eb0 con 0x7fe6040a5040 2026-02-17T12:05:18.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe6040a8a60 con 0x7fe60409be20 2026-02-17T12:05:18.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:18.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe60888b640 10 monclient(hunting): authenticate will time out at 569.682382s 2026-02-17T12:05:18.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe60409be20 0x7fe6041d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe60409be20 0x7fe6041d2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:50948/0 (socket says 10.20.193.77:50948) 2026-02-17T12:05:18.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 1 -- 10.20.193.77:0/3566067358 learned_addr learned my addr 10.20.193.77:0/3566067358 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:18.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 10 monclient(hunting): get_auth_request con 0x7fe60409be20 auth_method 0 2026-02-17T12:05:18.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601d74640 1 --2- 10.20.193.77:0/3566067358 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe6040a4c20 0x7fe6040a3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.023 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601d74640 10 monclient(hunting): get_auth_request con 0x7fe6040a4c20 auth_method 0 2026-02-17T12:05:18.024 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.024 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.024 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.024 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.024 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.024 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe601d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.024 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602d76640 1 --2- 10.20.193.77:0/3566067358 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe6040a5040 0x7fe6040a4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.024 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602d76640 10 monclient(hunting): get_auth_request con 0x7fe6040a5040 auth_method 0 2026-02-17T12:05:18.024 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.024 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.025 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.025 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 10 monclient(hunting): handle_auth_done global_id 4319 payload 824 2026-02-17T12:05:18.025 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 1 -- 10.20.193.77:0/3566067358 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe6040a5040 msgr2=0x7fe6040a4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.025 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 1 --2- 10.20.193.77:0/3566067358 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe6040a5040 0x7fe6040a4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.025 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 1 -- 10.20.193.77:0/3566067358 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe6040a4c20 msgr2=0x7fe6040a3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.025 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 1 --2- 10.20.193.77:0/3566067358 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe6040a4c20 0x7fe6040a3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.025 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 10 monclient: _finish_hunting 0 2026-02-17T12:05:18.025 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 1 monclient: found mon.noname-c 2026-02-17T12:05:18.025 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:18.025 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.025 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.002+0000 7fe602575640 1 -- 10.20.193.77:0/3566067358 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60409e9e0 con 0x7fe60409be20 2026-02-17T12:05:18.026 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe602575640 1 -- 10.20.193.77:0/3566067358 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe60409be20 msgr2=0x7fe6041d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:18.026 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe602575640 1 --2- 10.20.193.77:0/3566067358 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe60409be20 0x7fe6041d2120 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800ebe0 tx=0x7fe5f800c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.026 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 1 -- 10.20.193.77:0/3566067358 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8017070 con 0x7fe60409be20 2026-02-17T12:05:18.026 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.026 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:18.026 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 10 monclient: dump: 2026-02-17T12:05:18.026 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.026 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.026 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.026 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.027 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.027 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.027 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.027 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.027 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.027 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.027 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:18.027 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:18.027 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:18.027 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 1 -- 10.20.193.77:0/3566067358 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f800ce40 con 0x7fe60409be20 2026-02-17T12:05:18.027 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:18.028 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 1 -- 10.20.193.77:0/3566067358 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8013670 con 0x7fe60409be20 2026-02-17T12:05:18.028 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.028 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:18.028 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 10 monclient: dump: 2026-02-17T12:05:18.028 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.028 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.028 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.028 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.028 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.028 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.028 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.029 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.029 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.029 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.029 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe60888b640 5 monclient: authenticate success, global_id 4319 2026-02-17T12:05:18.029 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe600d72640 4 set_mon_vals no callback set 2026-02-17T12:05:18.029 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe60888b640 10 monclient: _renew_subs 2026-02-17T12:05:18.029 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe60888b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.029 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe60888b640 1 -- 10.20.193.77:0/3566067358 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60406f590 con 0x7fe60409be20 2026-02-17T12:05:18.029 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe60888b640 10 monclient: _renew_subs 2026-02-17T12:05:18.029 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe60888b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.029 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe60888b640 1 -- 10.20.193.77:0/3566067358 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60409e700 con 0x7fe60409be20 2026-02-17T12:05:18.029 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe60888b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.030 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe60888b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.030 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe60888b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.030 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe60888b640 1 -- 10.20.193.77:0/3566067358 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe60409e2b0 con 0x7fe60409be20 2026-02-17T12:05:18.030 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 1 -- 10.20.193.77:0/3566067358 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fe5f8024060 con 0x7fe60409be20 2026-02-17T12:05:18.030 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 1 --2- 10.20.193.77:0/3566067358 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe5d003a170 0x7fe5d003c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.030 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 1 -- 10.20.193.77:0/3566067358 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3558+0+0 (secure 0 0 0) 0x7fe5f804db60 con 0x7fe60409be20 2026-02-17T12:05:18.030 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe601d74640 1 --2- 10.20.193.77:0/3566067358 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe5d003a170 0x7fe5d003c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.030 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe601d74640 10 monclient: get_auth_request con 0x7fe5d003a170 auth_method 0 2026-02-17T12:05:18.030 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 1 -- 10.20.193.77:0/3566067358 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7fe60409e2b0 con 0x7fe60409be20 2026-02-17T12:05:18.030 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.030 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.006+0000 7fe5eaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:18.030 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.010+0000 7fe601d74640 1 --2- 10.20.193.77:0/3566067358 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe5d003a170 0x7fe5d003c630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe6040a7cb0 tx=0x7fe5ec0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.087 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.082+0000 7fe60888b640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:18.087 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.082+0000 7fe60888b640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:18.087 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.082+0000 7fe60888b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.087 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.082+0000 7fe60888b640 1 -- 10.20.193.77:0/3566067358 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe604134e00 con 0x7fe60409be20 2026-02-17T12:05:18.087 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe5eaffd640 1 -- 10.20.193.77:0/3566067358 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+10772 (secure 0 0 0) 0x7fe5f801ac80 con 0x7fe60409be20 2026-02-17T12:05:18.087 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe5eaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:05:18.087 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe5eaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:18.088 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:05:18.088 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":21,"fsid":"093d53f2-7cd0-4506-a27d-4c950e190615","created":"2026-02-17T12:04:53.336611+0000","modified":"2026-02-17T12:05:18.031054+0000","last_up_change":"2026-02-17T12:05:05.953164+0000","last_in_change":"2026-02-17T12:04:55.265712+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T12:05:06.312998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T12:05:10.954009+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6780fd-cb0e-481f-8816-a32e3434b102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6800","nonce":1107649769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":1107649769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1107649769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":1107649769}]},"public_addr":"10.20.193.77:6800/1107649769","cluster_addr":"10.20.193.77:6802/1107649769","heartbeat_back_addr":"10.20.193.77:6806/1107649769","heartbeat_front_addr":"10.20.193.77:6804/1107649769","state":["exists","up"]},{"osd":1,"uuid":"a82a493e-88de-4b65-ab23-41b52ffb6b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":662135547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":662135547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":662135547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":662135547}]},"public_addr":"10.20.193.77:6801/662135547","cluster_addr":"10.20.193.77:6803/662135547","heartbeat_back_addr":"10.20.193.77:6807/662135547","heartbeat_front_addr":"10.20.193.77:6805/662135547","state":["exists","up"]},{"osd":2,"uuid":"02ae9c66-fa9e-46d2-8be5-ba695ba4763b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":3812083705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":3812083705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":3812083705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":3812083705}]},"public_addr":"10.20.193.77:6808/3812083705","cluster_addr":"10.20.193.77:6809/3812083705","heartbeat_back_addr":"10.20.193.77:6811/3812083705","heartbeat_front_addr":"10.20.193.77:6810/3812083705","state":["exists","up"]},{"osd":3,"uuid":"fe40e683-451d-4e8a-94f4-69ace432df28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6801","nonce":3041501560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6802","nonce":3041501560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6804","nonce":3041501560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6803","nonce":3041501560}]},"public_addr":"10.20.193.119:6801/3041501560","cluster_addr":"10.20.193.119:6802/3041501560","heartbeat_back_addr":"10.20.193.119:6804/3041501560","heartbeat_front_addr":"10.20.193.119:6803/3041501560","state":["exists","up"]},{"osd":4,"uuid":"e6fc84bb-bd81-49d5-8cfd-b4ab0468d8dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6805","nonce":4132502681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6806","nonce":4132502681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6808","nonce":4132502681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6807","nonce":4132502681}]},"public_addr":"10.20.193.119:6805/4132502681","cluster_addr":"10.20.193.119:6806/4132502681","heartbeat_back_addr":"10.20.193.119:6808/4132502681","heartbeat_front_addr":"10.20.193.119:6807/4132502681","state":["exists","up"]},{"osd":5,"uuid":"400ef2a1-c8ee-4376-b3d9-588e2a34ad9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6809","nonce":3174335982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6810","nonce":3174335982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6812","nonce":3174335982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6811","nonce":3174335982}]},"public_addr":"10.20.193.119:6809/3174335982","cluster_addr":"10.20.193.119:6810/3174335982","heartbeat_back_addr":"10.20.193.119:6812/3174335982","heartbeat_front_addr":"10.20.193.119:6811/3174335982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:05:18.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe60888b640 1 -- 10.20.193.77:0/3566067358 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe5d003a170 msgr2=0x7fe5d003c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe60888b640 1 --2- 10.20.193.77:0/3566067358 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe5d003a170 0x7fe5d003c630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe6040a7cb0 tx=0x7fe5ec0a7000 comp rx=0 tx=0).stop 2026-02-17T12:05:18.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe60888b640 10 monclient: shutdown 2026-02-17T12:05:18.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe60888b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:18.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe60888b640 1 -- 10.20.193.77:0/3566067358 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe60409be20 msgr2=0x7fe6041d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe60888b640 1 --2- 10.20.193.77:0/3566067358 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe60409be20 0x7fe6041d2120 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800ebe0 tx=0x7fe5f800c520 comp rx=0 tx=0).stop 2026-02-17T12:05:18.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe60888b640 1 -- 10.20.193.77:0/3566067358 shutdown_connections 2026-02-17T12:05:18.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe60888b640 1 --2- 10.20.193.77:0/3566067358 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe5d003a170 0x7fe5d003c630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe60888b640 1 --2- 10.20.193.77:0/3566067358 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe6040a5040 0x7fe6040a4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe60888b640 1 --2- 10.20.193.77:0/3566067358 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe6040a4c20 0x7fe6040a3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe60888b640 1 --2- 10.20.193.77:0/3566067358 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe60409be20 0x7fe6041d2120 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe60888b640 1 -- 10.20.193.77:0/3566067358 >> 10.20.193.77:0/3566067358 conn(0x7fe604074ba0 msgr2=0x7fe604132a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:18.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe60888b640 1 -- 10.20.193.77:0/3566067358 shutdown_connections 2026-02-17T12:05:18.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.086+0000 7fe60888b640 1 -- 10.20.193.77:0/3566067358 wait complete. 2026-02-17T12:05:18.098 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-17T12:05:06.312998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2026-02-17T12:05:10.954009+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-17T12:05:18.099 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-17T12:05:18.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 10 monclient: get_monmap_and_config 2026-02-17T12:05:18.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 10 monclient: build_initial_monmap 2026-02-17T12:05:18.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 10 monclient: monmap: 2026-02-17T12:05:18.170 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:18.170 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.170 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:18.172323+0000 2026-02-17T12:05:18.170 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:18.172323+0000 2026-02-17T12:05:18.170 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:18.170 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.170 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:18.170 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:18.170 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:18.170 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:18.170 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:18.170 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 1 Processor -- start 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 1 -- start start 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 10 monclient: init 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 10 monclient: _add_conns ranks=[3,0,4,2,1] 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fd95009ca20 0x7fd95009ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 10 monclient(hunting): picked mon.noname-a con 0x7fd95009ca20 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd9500a21a0 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fd9500a2cc0 0x7fd95013d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 10 monclient(hunting): picked mon.noname-c con 0x7fd9500a2cc0 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd95009e330 con 0x7fd9500a21a0 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd9500750c0 con 0x7fd95009ca20 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd95009d6b0 con 0x7fd9500a2cc0 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd956938640 10 monclient(hunting): authenticate will time out at 569.847707s 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd94ffff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fd95009ca20 0x7fd95009ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd94f7fe640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7fd9500a21a0 0x7fd9500a25b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42442/0 (socket says 10.20.193.77:42442) 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd94ffff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fd95009ca20 0x7fd95009ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44608/0 (socket says 10.20.193.77:44608) 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd94f7fe640 1 -- 10.20.193.77:0/4174966662 learned_addr learned my addr 10.20.193.77:0/4174966662 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd94ffff640 10 monclient(hunting): get_auth_request con 0x7fd95009ca20 auth_method 0 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd94ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd94ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd94ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd94ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd94ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd94ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd954eae640 1 --2- 10.20.193.77:0/4174966662 >> v2:10.20.193.119:3300/0 conn(0x7fd9500a2cc0 0x7fd95013d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd954eae640 10 monclient(hunting): get_auth_request con 0x7fd9500a2cc0 auth_method 0 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd954eae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd954eae640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.166+0000 7fd954eae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94ffff640 10 monclient(hunting): handle_auth_done global_id 4323 payload 274 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94ffff640 1 -- 10.20.193.77:0/4174966662 >> v2:10.20.193.119:3300/0 conn(0x7fd9500a2cc0 msgr2=0x7fd95013d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94ffff640 1 --2- 10.20.193.77:0/4174966662 >> v2:10.20.193.119:3300/0 conn(0x7fd9500a2cc0 0x7fd95013d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94ffff640 1 -- 10.20.193.77:0/4174966662 >> v1:10.20.193.77:6789/0 conn(0x7fd9500a21a0 legacy=0x7fd9500a25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94ffff640 1 monclient: found mon.noname-a 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94ffff640 1 -- 10.20.193.77:0/4174966662 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95009efe0 con 0x7fd95009ca20 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94ffff640 1 -- 10.20.193.77:0/4174966662 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd95009ca20 msgr2=0x7fd95009ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:18.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94ffff640 1 --2- 10.20.193.77:0/4174966662 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd95009ca20 0x7fd95009ddf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd95009d320 tx=0x7fd93c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473ae85dbbf05330 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94effd640 1 -- 10.20.193.77:0/4174966662 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0b0070 con 0x7fd95009ca20 2026-02-17T12:05:18.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:18.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94effd640 10 monclient: dump: 2026-02-17T12:05:18.174 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.174 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.174 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.174 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.174 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.174 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.174 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.174 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94effd640 10 monclient: _finish_auth 0 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94effd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94effd640 1 -- 10.20.193.77:0/4174966662 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93c0ab600 con 0x7fd95009ca20 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94effd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94effd640 1 -- 10.20.193.77:0/4174966662 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0ab9d0 con 0x7fd95009ca20 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd956938640 5 monclient: authenticate success, global_id 4323 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd956938640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd956938640 4 set_mon_vals no callback set 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd94effd640 10 monclient: dump: 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd956938640 10 monclient: shutdown 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd956938640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd956938640 1 -- 10.20.193.77:0/4174966662 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd95009ca20 msgr2=0x7fd95009ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd956938640 1 --2- 10.20.193.77:0/4174966662 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd95009ca20 0x7fd95009ddf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd95009d320 tx=0x7fd93c01c440 comp rx=0 tx=0).stop 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd956938640 1 -- 10.20.193.77:0/4174966662 shutdown_connections 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd956938640 1 --2- 10.20.193.77:0/4174966662 >> v2:10.20.193.119:3300/0 conn(0x7fd9500a2cc0 0x7fd95013d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd956938640 1 --2- 10.20.193.77:0/4174966662 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd95009ca20 0x7fd95009ddf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd956938640 1 -- 10.20.193.77:0/4174966662 >> 10.20.193.77:0/4174966662 conn(0x7fd9500a3290 msgr2=0x7fd9500a36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:18.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd956938640 1 -- 10.20.193.77:0/4174966662 shutdown_connections 2026-02-17T12:05:18.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.170+0000 7fd956938640 1 -- 10.20.193.77:0/4174966662 wait complete. 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient: build_initial_monmap 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient: monmap: 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 1 Processor -- start 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 1 -- start start 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient: init 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd95009ca20 0x7fd95013b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient(hunting): picked mon.noname-b con 0x7fd95009ca20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd9500a21a0 0x7fd95013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient(hunting): picked mon.noname-a con 0x7fd9500a21a0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd9500a2cc0 0x7fd95013bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient(hunting): picked mon.noname-c con 0x7fd9500a2cc0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd950140820 con 0x7fd9500a21a0 2026-02-17T12:05:18.177 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd9501406a0 con 0x7fd95009ca20 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd9501409a0 con 0x7fd9500a2cc0 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient(hunting): authenticate will time out at 569.852993s 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94f7fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd9500a21a0 0x7fd95013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94f7fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd9500a21a0 0x7fd95013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44624/0 (socket says 10.20.193.77:44624) 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd9500a2cc0 0x7fd95013bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94f7fe640 1 -- 10.20.193.77:0/3708207164 learned_addr learned my addr 10.20.193.77:0/3708207164 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94f7fe640 10 monclient(hunting): get_auth_request con 0x7fd9500a21a0 auth_method 0 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 10 monclient(hunting): get_auth_request con 0x7fd9500a2cc0 auth_method 0 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94ffff640 1 --2- 10.20.193.77:0/3708207164 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd95009ca20 0x7fd95013b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94ffff640 10 monclient(hunting): get_auth_request con 0x7fd95009ca20 auth_method 0 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 10 monclient(hunting): handle_auth_done global_id 4322 payload 824 2026-02-17T12:05:18.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 1 -- 10.20.193.77:0/3708207164 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd95009ca20 msgr2=0x7fd95013b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 1 --2- 10.20.193.77:0/3708207164 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd95009ca20 0x7fd95013b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 1 -- 10.20.193.77:0/3708207164 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd9500a21a0 msgr2=0x7fd95013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 1 --2- 10.20.193.77:0/3708207164 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd9500a21a0 0x7fd95013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 10 monclient: _finish_hunting 0 2026-02-17T12:05:18.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 1 monclient: found mon.noname-c 2026-02-17T12:05:18.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:18.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 1 -- 10.20.193.77:0/3708207164 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9500700c0 con 0x7fd9500a2cc0 2026-02-17T12:05:18.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94f7fe640 1 --2- 10.20.193.77:0/3708207164 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd9500a21a0 0x7fd95013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 1 -- 10.20.193.77:0/3708207164 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd9500a2cc0 msgr2=0x7fd95013bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd954eae640 1 --2- 10.20.193.77:0/3708207164 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd9500a2cc0 0x7fd95013bb20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd944007dc0 tx=0x7fd94400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94cff9640 1 -- 10.20.193.77:0/3708207164 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944003aa0 con 0x7fd9500a2cc0 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94cff9640 10 monclient: dump: 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94cff9640 10 monclient: _finish_auth 0 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94cff9640 10 monclient: _check_auth_tickets 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94cff9640 1 -- 10.20.193.77:0/3708207164 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd944003c60 con 0x7fd9500a2cc0 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94cff9640 1 -- 10.20.193.77:0/3708207164 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944004260 con 0x7fd9500a2cc0 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94cff9640 10 monclient: dump: 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.180 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd94e7fc640 4 set_mon_vals no callback set 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 5 monclient: authenticate success, global_id 4322 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient: _renew_subs 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 1 -- 10.20.193.77:0/3708207164 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95008e4d0 con 0x7fd9500a2cc0 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient: _renew_subs 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.174+0000 7fd956938640 1 -- 10.20.193.77:0/3708207164 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95013d7e0 con 0x7fd9500a2cc0 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.178+0000 7fd956938640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.178+0000 7fd956938640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.178+0000 7fd956938640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.178+0000 7fd956938640 1 -- 10.20.193.77:0/3708207164 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd95009ddf0 con 0x7fd9500a2cc0 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.178+0000 7fd94cff9640 1 -- 10.20.193.77:0/3708207164 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fd944004440 con 0x7fd9500a2cc0 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.178+0000 7fd94cff9640 1 --2- 10.20.193.77:0/3708207164 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd92003a170 0x7fd92003c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.178+0000 7fd94cff9640 1 -- 10.20.193.77:0/3708207164 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 3530+0+0 (secure 0 0 0) 0x7fd94404ddd0 con 0x7fd9500a2cc0 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.178+0000 7fd94ffff640 1 --2- 10.20.193.77:0/3708207164 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd92003a170 0x7fd92003c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.178+0000 7fd94ffff640 10 monclient: get_auth_request con 0x7fd92003a170 auth_method 0 2026-02-17T12:05:18.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.178+0000 7fd94ffff640 1 --2- 10.20.193.77:0/3708207164 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd92003a170 0x7fd92003c630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd93c0ab000 tx=0x7fd93c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.178+0000 7fd94cff9640 1 -- 10.20.193.77:0/3708207164 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7fd9500700c0 con 0x7fd9500a2cc0 2026-02-17T12:05:18.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.178+0000 7fd94cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.178+0000 7fd94cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:18.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-17T12:05:18.261 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-17T12:05:18.261 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.261 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 1 -- 10.20.193.77:0/3708207164 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd95006d670 con 0x7fd9500a2cc0 2026-02-17T12:05:18.261 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd94cff9640 1 -- 10.20.193.77:0/3708207164 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fd944003e10 con 0x7fd9500a2cc0 2026-02-17T12:05:18.261 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd94cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-17T12:05:18.261 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd94cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:18.262 INFO:teuthology.orchestra.run.trial077.stdout:pg_num: 1 2026-02-17T12:05:18.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 1 -- 10.20.193.77:0/3708207164 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd92003a170 msgr2=0x7fd92003c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 1 --2- 10.20.193.77:0/3708207164 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd92003a170 0x7fd92003c630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd93c0ab000 tx=0x7fd93c008040 comp rx=0 tx=0).stop 2026-02-17T12:05:18.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 10 monclient: shutdown 2026-02-17T12:05:18.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:18.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 1 -- 10.20.193.77:0/3708207164 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd9500a2cc0 msgr2=0x7fd95013bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 1 --2- 10.20.193.77:0/3708207164 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd9500a2cc0 0x7fd95013bb20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd944007dc0 tx=0x7fd94400e4b0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 1 -- 10.20.193.77:0/3708207164 shutdown_connections 2026-02-17T12:05:18.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 1 --2- 10.20.193.77:0/3708207164 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd92003a170 0x7fd92003c630 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 1 --2- 10.20.193.77:0/3708207164 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd9500a2cc0 0x7fd95013bb20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 1 --2- 10.20.193.77:0/3708207164 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd9500a21a0 0x7fd95013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 1 --2- 10.20.193.77:0/3708207164 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd95009ca20 0x7fd95013b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 1 -- 10.20.193.77:0/3708207164 >> 10.20.193.77:0/3708207164 conn(0x7fd9500a3290 msgr2=0x7fd950099700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:18.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 1 -- 10.20.193.77:0/3708207164 shutdown_connections 2026-02-17T12:05:18.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.258+0000 7fd956938640 1 -- 10.20.193.77:0/3708207164 wait complete. 2026-02-17T12:05:18.271 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2026-02-17T12:05:18.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 10 monclient: get_monmap_and_config 2026-02-17T12:05:18.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 10 monclient: build_initial_monmap 2026-02-17T12:05:18.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 10 monclient: monmap: 2026-02-17T12:05:18.336 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:18.336 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.336 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:18.337593+0000 2026-02-17T12:05:18.336 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:18.337593+0000 2026-02-17T12:05:18.336 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:18.336 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.336 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:18.336 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:18.336 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:18.336 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:18.336 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:18.336 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 1 Processor -- start 2026-02-17T12:05:18.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 1 -- start start 2026-02-17T12:05:18.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 10 monclient: init 2026-02-17T12:05:18.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:18.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 10 monclient: _add_conns ranks=[2,3,0,4,1] 2026-02-17T12:05:18.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7faba0138070 0x7faba0138450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 10 monclient(hunting): picked mon.noname-b con 0x7faba0138070 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:18.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7faba00a69f0 0x7faba0138990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 10 monclient(hunting): picked mon.noname-a con 0x7faba00a69f0 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:18.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7faba0136ff0 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:18.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faba009be20 con 0x7faba0136ff0 2026-02-17T12:05:18.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7faba00a6830 con 0x7faba00a69f0 2026-02-17T12:05:18.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7faba009dc10 con 0x7faba0138070 2026-02-17T12:05:18.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:18.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9ffff640 10 monclient(hunting): authenticate will time out at 570.013296s 2026-02-17T12:05:18.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7faba00a69f0 0x7faba0138990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9effd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7faba0138070 0x7faba0138450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9f7fe640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7faba0136ff0 0x7faba0137480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42450/0 (socket says 10.20.193.77:42450) 2026-02-17T12:05:18.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9f7fe640 1 -- 10.20.193.77:0/3924994941 learned_addr learned my addr 10.20.193.77:0/3924994941 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:18.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 10 monclient(hunting): get_auth_request con 0x7faba00a69f0 auth_method 0 2026-02-17T12:05:18.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9effd640 10 monclient(hunting): get_auth_request con 0x7faba0138070 auth_method 0 2026-02-17T12:05:18.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.341 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 10 monclient(hunting): handle_auth_done global_id 4329 payload 274 2026-02-17T12:05:18.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 1 -- 10.20.193.77:0/3924994941 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7faba0138070 msgr2=0x7faba0138450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:18.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 1 --2- 10.20.193.77:0/3924994941 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7faba0138070 0x7faba0138450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 1 -- 10.20.193.77:0/3924994941 >> v1:10.20.193.77:6789/0 conn(0x7faba0136ff0 legacy=0x7faba0137480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:18.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:05:18.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 1 monclient: found mon.noname-a 2026-02-17T12:05:18.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:18.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:18.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.334+0000 7fab9e7fc640 1 -- 10.20.193.77:0/3924994941 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba009c8c0 con 0x7faba00a69f0 2026-02-17T12:05:18.349 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9e7fc640 1 -- 10.20.193.77:0/3924994941 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7faba00a69f0 msgr2=0x7faba0138990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:18.349 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9e7fc640 1 --2- 10.20.193.77:0/3924994941 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7faba00a69f0 0x7faba0138990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fab880098c0 tx=0x7fab8801c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c386f78695c371d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.349 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9dffb640 1 -- 10.20.193.77:0/3924994941 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab880b0070 con 0x7faba00a69f0 2026-02-17T12:05:18.349 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.350 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:18.350 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9dffb640 10 monclient: dump: 2026-02-17T12:05:18.350 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.350 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.350 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.350 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.350 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.350 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.350 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.350 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.350 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.350 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9dffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:18.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:18.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:18.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9dffb640 1 -- 10.20.193.77:0/3924994941 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab880ab600 con 0x7faba00a69f0 2026-02-17T12:05:18.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 5 monclient: authenticate success, global_id 4329 2026-02-17T12:05:18.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:18.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:18.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9dffb640 1 -- 10.20.193.77:0/3924994941 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab880ab9d0 con 0x7faba00a69f0 2026-02-17T12:05:18.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:18.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 4 set_mon_vals no callback set 2026-02-17T12:05:18.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.351 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:18.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9dffb640 10 monclient: dump: 2026-02-17T12:05:18.352 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.352 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.352 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.352 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.352 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.352 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.352 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.352 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.352 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.352 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.352 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient: shutdown 2026-02-17T12:05:18.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:18.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 -- 10.20.193.77:0/3924994941 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7faba00a69f0 msgr2=0x7faba0138990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 --2- 10.20.193.77:0/3924994941 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7faba00a69f0 0x7faba0138990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fab880098c0 tx=0x7fab8801c2a0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 -- 10.20.193.77:0/3924994941 shutdown_connections 2026-02-17T12:05:18.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 --2- 10.20.193.77:0/3924994941 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7faba00a69f0 0x7faba0138990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 --2- 10.20.193.77:0/3924994941 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7faba0138070 0x7faba0138450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 -- 10.20.193.77:0/3924994941 >> 10.20.193.77:0/3924994941 conn(0x7faba00a7740 msgr2=0x7faba00a7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:18.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 -- 10.20.193.77:0/3924994941 shutdown_connections 2026-02-17T12:05:18.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 -- 10.20.193.77:0/3924994941 wait complete. 2026-02-17T12:05:18.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient: build_initial_monmap 2026-02-17T12:05:18.353 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient: monmap: 2026-02-17T12:05:18.353 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:18.354 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:18.354 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:18.354 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:18.354 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:18.354 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.354 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:18.354 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:18.354 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:18.354 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 Processor -- start 2026-02-17T12:05:18.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 -- start start 2026-02-17T12:05:18.354 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient: init 2026-02-17T12:05:18.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:18.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:05:18.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7faba00a69f0 0x7faba01d2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient(hunting): picked mon.noname-a con 0x7faba00a69f0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:18.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7faba0136ff0 0x7faba0136260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient(hunting): picked mon.noname-c con 0x7faba0136ff0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:18.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faba0138070 0x7faba013c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient(hunting): picked mon.noname-b con 0x7faba0138070 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:18.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7faba009d810 con 0x7faba00a69f0 2026-02-17T12:05:18.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.355 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7faba0142de0 con 0x7faba0138070 2026-02-17T12:05:18.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7faba00a4ba0 con 0x7faba0136ff0 2026-02-17T12:05:18.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:18.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9ffff640 10 monclient(hunting): authenticate will time out at 570.018649s 2026-02-17T12:05:18.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7faba00a69f0 0x7faba01d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7faba00a69f0 0x7faba01d2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44636/0 (socket says 10.20.193.77:44636) 2026-02-17T12:05:18.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 1 -- 10.20.193.77:0/1543918717 learned_addr learned my addr 10.20.193.77:0/1543918717 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:18.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 10 monclient(hunting): get_auth_request con 0x7faba00a69f0 auth_method 0 2026-02-17T12:05:18.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9e7fc640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7faba0136ff0 0x7faba0136260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.356 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9e7fc640 10 monclient(hunting): get_auth_request con 0x7faba0136ff0 auth_method 0 2026-02-17T12:05:18.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 10 monclient(hunting): handle_auth_done global_id 4332 payload 824 2026-02-17T12:05:18.357 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9f7fe640 1 --2- 10.20.193.77:0/1543918717 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faba0138070 0x7faba013c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 1 -- 10.20.193.77:0/1543918717 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7faba0136ff0 msgr2=0x7faba0136260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 1 --2- 10.20.193.77:0/1543918717 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7faba0136ff0 0x7faba0136260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 1 -- 10.20.193.77:0/1543918717 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faba0138070 msgr2=0x7faba013c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 1 --2- 10.20.193.77:0/1543918717 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faba0138070 0x7faba013c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 10 monclient: _finish_hunting 0 2026-02-17T12:05:18.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 1 monclient: found mon.noname-a 2026-02-17T12:05:18.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:18.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:18.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9effd640 1 -- 10.20.193.77:0/1543918717 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba00a1a30 con 0x7faba00a69f0 2026-02-17T12:05:18.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9f7fe640 10 monclient: get_auth_request con 0x7faba0138070 auth_method 0 2026-02-17T12:05:18.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9e7fc640 1 --2- 10.20.193.77:0/1543918717 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7faba0136ff0 0x7faba0136260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:18.358 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.338+0000 7fab9f7fe640 1 --2- 10.20.193.77:0/1543918717 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faba0138070 0x7faba013c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:05:18.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9effd640 1 -- 10.20.193.77:0/1543918717 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7faba00a69f0 msgr2=0x7faba01d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:18.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9effd640 1 --2- 10.20.193.77:0/1543918717 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7faba00a69f0 0x7faba01d2190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fab9400ec10 tx=0x7fab9400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 1 -- 10.20.193.77:0/1543918717 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94017070 con 0x7faba00a69f0 2026-02-17T12:05:18.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:18.359 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 10 monclient: dump: 2026-02-17T12:05:18.359 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.359 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.359 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.359 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.360 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.360 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.360 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.360 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.360 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.360 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:18.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:18.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:18.360 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 1 -- 10.20.193.77:0/1543918717 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9400ce40 con 0x7faba00a69f0 2026-02-17T12:05:18.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:18.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 1 -- 10.20.193.77:0/1543918717 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94013670 con 0x7faba00a69f0 2026-02-17T12:05:18.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:18.361 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 10 monclient: dump: 2026-02-17T12:05:18.361 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.362 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.362 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.362 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.362 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.362 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.362 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.362 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.362 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.363 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9d7fa640 4 set_mon_vals no callback set 2026-02-17T12:05:18.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9ffff640 5 monclient: authenticate success, global_id 4332 2026-02-17T12:05:18.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9ffff640 10 monclient: _renew_subs 2026-02-17T12:05:18.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9ffff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:18.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9ffff640 1 -- 10.20.193.77:0/1543918717 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba00a9510 con 0x7faba00a69f0 2026-02-17T12:05:18.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9ffff640 10 monclient: _renew_subs 2026-02-17T12:05:18.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9ffff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:18.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9ffff640 1 -- 10.20.193.77:0/1543918717 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba0140060 con 0x7faba00a69f0 2026-02-17T12:05:18.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9ffff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.363 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9ffff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9ffff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:18.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9ffff640 1 -- 10.20.193.77:0/1543918717 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba0137480 con 0x7faba00a69f0 2026-02-17T12:05:18.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 1 -- 10.20.193.77:0/1543918717 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fab94024060 con 0x7faba00a69f0 2026-02-17T12:05:18.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 1 --2- 10.20.193.77:0/1543918717 >> v2:10.20.193.119:6800/4127986552 conn(0x7fab6c03a170 0x7fab6c03c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab7f7fe640 1 -- 10.20.193.77:0/1543918717 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3530+0+0 (secure 0 0 0) 0x7fab9404db00 con 0x7faba00a69f0 2026-02-17T12:05:18.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9e7fc640 1 --2- 10.20.193.77:0/1543918717 >> v2:10.20.193.119:6800/4127986552 conn(0x7fab6c03a170 0x7fab6c03c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.342+0000 7fab9e7fc640 10 monclient: get_auth_request con 0x7fab6c03a170 auth_method 0 2026-02-17T12:05:18.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.346+0000 7fab7f7fe640 1 -- 10.20.193.77:0/1543918717 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7fab9401ac80 con 0x7faba00a69f0 2026-02-17T12:05:18.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.346+0000 7fab7f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.364 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.346+0000 7fab7f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:18.365 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.346+0000 7fab9e7fc640 1 --2- 10.20.193.77:0/1543918717 >> v2:10.20.193.119:6800/4127986552 conn(0x7fab6c03a170 0x7fab6c03c630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faba00a6e90 tx=0x7fab88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.424 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-17T12:05:18.424 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-17T12:05:18.425 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:18.425 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 1 -- 10.20.193.77:0/1543918717 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7faba0068d20 con 0x7faba00a69f0 2026-02-17T12:05:18.425 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab7f7fe640 1 -- 10.20.193.77:0/1543918717 <== mon.0 v2:10.20.193.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) ==== 92+0+10 (secure 0 0 0) 0x7fab94013850 con 0x7faba00a69f0 2026-02-17T12:05:18.425 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab7f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-17T12:05:18.425 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab7f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:18.425 INFO:teuthology.orchestra.run.trial077.stdout:pg_num: 8 2026-02-17T12:05:18.426 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 1 -- 10.20.193.77:0/1543918717 >> v2:10.20.193.119:6800/4127986552 conn(0x7fab6c03a170 msgr2=0x7fab6c03c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.426 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 1 --2- 10.20.193.77:0/1543918717 >> v2:10.20.193.119:6800/4127986552 conn(0x7fab6c03a170 0x7fab6c03c630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faba00a6e90 tx=0x7fab88008040 comp rx=0 tx=0).stop 2026-02-17T12:05:18.426 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 10 monclient: shutdown 2026-02-17T12:05:18.426 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:18.426 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 1 -- 10.20.193.77:0/1543918717 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7faba00a69f0 msgr2=0x7faba01d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.426 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 1 --2- 10.20.193.77:0/1543918717 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7faba00a69f0 0x7faba01d2190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fab9400ec10 tx=0x7fab9400c520 comp rx=0 tx=0).stop 2026-02-17T12:05:18.426 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 1 -- 10.20.193.77:0/1543918717 shutdown_connections 2026-02-17T12:05:18.426 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 1 --2- 10.20.193.77:0/1543918717 >> v2:10.20.193.119:6800/4127986552 conn(0x7fab6c03a170 0x7fab6c03c630 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.426 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 1 --2- 10.20.193.77:0/1543918717 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7faba0138070 0x7faba013c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.426 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 1 --2- 10.20.193.77:0/1543918717 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7faba0136ff0 0x7faba0136260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.426 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 1 --2- 10.20.193.77:0/1543918717 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7faba00a69f0 0x7faba01d2190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.427 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 1 -- 10.20.193.77:0/1543918717 >> 10.20.193.77:0/1543918717 conn(0x7faba00a7740 msgr2=0x7faba009e690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:18.427 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 1 -- 10.20.193.77:0/1543918717 shutdown_connections 2026-02-17T12:05:18.427 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.422+0000 7fab9ffff640 1 -- 10.20.193.77:0/1543918717 wait complete. 2026-02-17T12:05:18.435 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2026-02-17T12:05:18.436 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:05:18.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 10 monclient: get_monmap_and_config 2026-02-17T12:05:18.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 10 monclient: build_initial_monmap 2026-02-17T12:05:18.507 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 10 monclient: monmap: 2026-02-17T12:05:18.507 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:18.507 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.508 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:18.507002+0000 2026-02-17T12:05:18.508 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:18.507002+0000 2026-02-17T12:05:18.508 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:18.508 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.508 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:18.508 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:18.508 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:18.508 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:18.508 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:18.508 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 1 Processor -- start 2026-02-17T12:05:18.508 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 1 -- start start 2026-02-17T12:05:18.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 10 monclient: init 2026-02-17T12:05:18.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:18.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 10 monclient: _add_conns ranks=[1,3,0,4,2] 2026-02-17T12:05:18.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f64b409be20 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:18.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f64b40a4c20 0x7f64b413d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 10 monclient(hunting): picked mon.noname-a con 0x7f64b40a4c20 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:18.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f64b40a5070 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:18.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b4135530 con 0x7f64b40a5070 2026-02-17T12:05:18.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b409cdf0 con 0x7f64b409be20 2026-02-17T12:05:18.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f64b409c200 con 0x7f64b40a4c20 2026-02-17T12:05:18.509 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:18.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64ba047640 10 monclient(hunting): authenticate will time out at 570.182476s 2026-02-17T12:05:18.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f64b40a4c20 0x7f64b413d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b3fff640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f64b40a5070 0x7f64b413f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42452/0 (socket says 10.20.193.77:42452) 2026-02-17T12:05:18.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b3fff640 1 -- 10.20.193.77:0/870666426 learned_addr learned my addr 10.20.193.77:0/870666426 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:18.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 10 monclient(hunting): get_auth_request con 0x7f64b40a4c20 auth_method 0 2026-02-17T12:05:18.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 10 monclient(hunting): handle_auth_done global_id 4335 payload 274 2026-02-17T12:05:18.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 1 -- 10.20.193.77:0/870666426 >> v1:10.20.193.119:6789/0 conn(0x7f64b409be20 legacy=0x7f64b4134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:18.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 1 -- 10.20.193.77:0/870666426 >> v1:10.20.193.77:6789/0 conn(0x7f64b40a5070 legacy=0x7f64b413f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:18.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:05:18.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 1 monclient: found mon.noname-a 2026-02-17T12:05:18.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:18.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:18.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.502+0000 7f64b2ffd640 1 -- 10.20.193.77:0/870666426 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b409d0d0 con 0x7f64b40a4c20 2026-02-17T12:05:18.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b2ffd640 1 -- 10.20.193.77:0/870666426 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f64b40a4c20 msgr2=0x7f64b413d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:18.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b2ffd640 1 --2- 10.20.193.77:0/870666426 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f64b40a4c20 0x7f64b413d470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f64a40098c0 tx=0x7f64a401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5cdd5a4e1e5dea server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b27fc640 1 -- 10.20.193.77:0/870666426 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a40b1070 con 0x7f64b40a4c20 2026-02-17T12:05:18.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:18.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b27fc640 10 monclient: dump: 2026-02-17T12:05:18.518 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.518 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.518 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.518 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.518 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.518 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.518 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.518 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.518 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.518 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b27fc640 10 monclient: _finish_auth 0 2026-02-17T12:05:18.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:05:18.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:18.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b27fc640 1 -- 10.20.193.77:0/870666426 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a40ac640 con 0x7f64b40a4c20 2026-02-17T12:05:18.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:18.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b27fc640 1 -- 10.20.193.77:0/870666426 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a40aca10 con 0x7f64b40a4c20 2026-02-17T12:05:18.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:18.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64b27fc640 10 monclient: dump: 2026-02-17T12:05:18.519 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.519 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.519 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.519 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.520 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.520 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.520 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.520 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.520 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.520 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64ba047640 5 monclient: authenticate success, global_id 4335 2026-02-17T12:05:18.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64ba047640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:18.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64ba047640 4 set_mon_vals no callback set 2026-02-17T12:05:18.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64ba047640 10 monclient: shutdown 2026-02-17T12:05:18.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64ba047640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:18.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64ba047640 1 -- 10.20.193.77:0/870666426 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f64b40a4c20 msgr2=0x7f64b413d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64ba047640 1 --2- 10.20.193.77:0/870666426 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f64b40a4c20 0x7f64b413d470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f64a40098c0 tx=0x7f64a401c480 comp rx=0 tx=0).stop 2026-02-17T12:05:18.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64ba047640 1 -- 10.20.193.77:0/870666426 shutdown_connections 2026-02-17T12:05:18.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64ba047640 1 --2- 10.20.193.77:0/870666426 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f64b40a4c20 0x7f64b413d470 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64ba047640 1 -- 10.20.193.77:0/870666426 >> 10.20.193.77:0/870666426 conn(0x7f64b4074ba0 msgr2=0x7f64b40aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:18.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64ba047640 1 -- 10.20.193.77:0/870666426 shutdown_connections 2026-02-17T12:05:18.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64ba047640 1 -- 10.20.193.77:0/870666426 wait complete. 2026-02-17T12:05:18.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64ba047640 10 monclient: build_initial_monmap 2026-02-17T12:05:18.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.506+0000 7f64ba047640 10 monclient: monmap: 2026-02-17T12:05:18.521 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:18.521 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:18.521 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:18.521 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:18.522 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:18.522 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.522 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:18.522 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:18.522 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:18.522 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.522 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 1 Processor -- start 2026-02-17T12:05:18.522 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 1 -- start start 2026-02-17T12:05:18.522 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient: init 2026-02-17T12:05:18.522 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:18.522 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:18.522 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f64b409be20 0x7f64b40a2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.522 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient(hunting): picked mon.noname-b con 0x7f64b409be20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:18.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f64b40a4c20 0x7f64b40a2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient(hunting): picked mon.noname-c con 0x7f64b40a4c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:18.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f64b40a5070 0x7f64b40a3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient(hunting): picked mon.noname-a con 0x7f64b40a5070 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:18.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f64b4143c90 con 0x7f64b40a5070 2026-02-17T12:05:18.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f64b4143b10 con 0x7f64b409be20 2026-02-17T12:05:18.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f64b4143e10 con 0x7f64b40a4c20 2026-02-17T12:05:18.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:18.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient(hunting): authenticate will time out at 570.188613s 2026-02-17T12:05:18.523 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f64b40a5070 0x7f64b40a3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f64b40a5070 0x7f64b40a3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44654/0 (socket says 10.20.193.77:44654) 2026-02-17T12:05:18.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 1 -- 10.20.193.77:0/1736232207 learned_addr learned my addr 10.20.193.77:0/1736232207 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:18.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 10 monclient(hunting): get_auth_request con 0x7f64b40a5070 auth_method 0 2026-02-17T12:05:18.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b37fe640 1 --2- 10.20.193.77:0/1736232207 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f64b409be20 0x7f64b40a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b2ffd640 1 --2- 10.20.193.77:0/1736232207 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f64b40a4c20 0x7f64b40a2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.524 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b37fe640 10 monclient(hunting): get_auth_request con 0x7f64b409be20 auth_method 0 2026-02-17T12:05:18.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b2ffd640 10 monclient(hunting): get_auth_request con 0x7f64b40a4c20 auth_method 0 2026-02-17T12:05:18.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 10 monclient(hunting): handle_auth_done global_id 4338 payload 824 2026-02-17T12:05:18.525 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 1 -- 10.20.193.77:0/1736232207 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f64b40a4c20 msgr2=0x7f64b40a2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 1 --2- 10.20.193.77:0/1736232207 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f64b40a4c20 0x7f64b40a2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 1 -- 10.20.193.77:0/1736232207 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f64b409be20 msgr2=0x7f64b40a2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 1 --2- 10.20.193.77:0/1736232207 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f64b409be20 0x7f64b40a2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:18.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 1 monclient: found mon.noname-a 2026-02-17T12:05:18.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:18.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:18.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 1 -- 10.20.193.77:0/1736232207 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b41343b0 con 0x7f64b40a5070 2026-02-17T12:05:18.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 1 -- 10.20.193.77:0/1736232207 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f64b40a5070 msgr2=0x7f64b40a3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:18.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b3fff640 1 --2- 10.20.193.77:0/1736232207 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f64b40a5070 0x7f64b40a3380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f64a800caf0 tx=0x7f64a800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f648ffff640 1 -- 10.20.193.77:0/1736232207 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a8012400 con 0x7f64b40a5070 2026-02-17T12:05:18.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f648ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.526 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f648ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:18.527 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f648ffff640 10 monclient: dump: 2026-02-17T12:05:18.527 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.527 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.527 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.527 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.527 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.527 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.527 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.527 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.527 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.528 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f648ffff640 10 monclient: _finish_auth 0 2026-02-17T12:05:18.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f648ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:18.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f648ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:18.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f648ffff640 1 -- 10.20.193.77:0/1736232207 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a80125c0 con 0x7f64b40a5070 2026-02-17T12:05:18.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f648ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:18.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f648ffff640 1 -- 10.20.193.77:0/1736232207 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a80129b0 con 0x7f64b40a5070 2026-02-17T12:05:18.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 5 monclient: authenticate success, global_id 4338 2026-02-17T12:05:18.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient: _renew_subs 2026-02-17T12:05:18.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:18.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64b1ffb640 4 set_mon_vals no callback set 2026-02-17T12:05:18.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 1 -- 10.20.193.77:0/1736232207 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b406f590 con 0x7f64b40a5070 2026-02-17T12:05:18.528 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f648ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f648ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:18.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f648ffff640 10 monclient: dump: 2026-02-17T12:05:18.529 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.529 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.529 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.529 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.529 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.529 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.529 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.529 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.529 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.529 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.529 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient: _renew_subs 2026-02-17T12:05:18.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:18.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 1 -- 10.20.193.77:0/1736232207 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b413ab50 con 0x7f64b40a5070 2026-02-17T12:05:18.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:18.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.510+0000 7f64ba047640 1 -- 10.20.193.77:0/1736232207 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b4134e00 con 0x7f64b40a5070 2026-02-17T12:05:18.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.514+0000 7f648ffff640 1 -- 10.20.193.77:0/1736232207 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f64a8012bd0 con 0x7f64b40a5070 2026-02-17T12:05:18.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.514+0000 7f648ffff640 1 --2- 10.20.193.77:0/1736232207 >> v2:10.20.193.119:6800/4127986552 conn(0x7f648403a170 0x7f648403c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.514+0000 7f648ffff640 1 -- 10.20.193.77:0/1736232207 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3530+0+0 (secure 0 0 0) 0x7f64a804def0 con 0x7f64b40a5070 2026-02-17T12:05:18.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.514+0000 7f64b37fe640 1 --2- 10.20.193.77:0/1736232207 >> v2:10.20.193.119:6800/4127986552 conn(0x7f648403a170 0x7f648403c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.514+0000 7f64b37fe640 10 monclient: get_auth_request con 0x7f648403a170 auth_method 0 2026-02-17T12:05:18.530 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.514+0000 7f648ffff640 1 -- 10.20.193.77:0/1736232207 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f64b41343b0 con 0x7f64b40a5070 2026-02-17T12:05:18.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.514+0000 7f648ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.514+0000 7f648ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:18.531 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.514+0000 7f64b37fe640 1 --2- 10.20.193.77:0/1736232207 >> v2:10.20.193.119:6800/4127986552 conn(0x7f648403a170 0x7f648403c630 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f64a00098f0 tx=0x7f64a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.592 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 1 -- 10.20.193.77:0/1736232207 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64b4140d10 con 0x7f648403a170 2026-02-17T12:05:18.593 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f648ffff640 1 -- 10.20.193.77:0/1736232207 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34183 (secure 0 0 0) 0x7f64b4140d10 con 0x7f648403a170 2026-02-17T12:05:18.594 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:05:18.595 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T12:05:18.595 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 1 -- 10.20.193.77:0/1736232207 >> v2:10.20.193.119:6800/4127986552 conn(0x7f648403a170 msgr2=0x7f648403c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.595 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 1 --2- 10.20.193.77:0/1736232207 >> v2:10.20.193.119:6800/4127986552 conn(0x7f648403a170 0x7f648403c630 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f64a00098f0 tx=0x7f64a0008040 comp rx=0 tx=0).stop 2026-02-17T12:05:18.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 10 monclient: shutdown 2026-02-17T12:05:18.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:18.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 1 -- 10.20.193.77:0/1736232207 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f64b40a5070 msgr2=0x7f64b40a3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 1 --2- 10.20.193.77:0/1736232207 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f64b40a5070 0x7f64b40a3380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f64a800caf0 tx=0x7f64a800a060 comp rx=0 tx=0).stop 2026-02-17T12:05:18.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 1 -- 10.20.193.77:0/1736232207 shutdown_connections 2026-02-17T12:05:18.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 1 --2- 10.20.193.77:0/1736232207 >> v2:10.20.193.119:6800/4127986552 conn(0x7f648403a170 0x7f648403c630 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 1 --2- 10.20.193.77:0/1736232207 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f64b40a5070 0x7f64b40a3380 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 1 --2- 10.20.193.77:0/1736232207 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f64b40a4c20 0x7f64b40a2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 1 --2- 10.20.193.77:0/1736232207 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f64b409be20 0x7f64b40a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 1 -- 10.20.193.77:0/1736232207 >> 10.20.193.77:0/1736232207 conn(0x7f64b4074ba0 msgr2=0x7f64b41380a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:18.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 1 -- 10.20.193.77:0/1736232207 shutdown_connections 2026-02-17T12:05:18.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.590+0000 7f64ba047640 1 -- 10.20.193.77:0/1736232207 wait complete. 2026-02-17T12:05:18.603 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2026-02-17T12:05:18.269474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":183680,"kb_used_data":1096,"kb_used_omap":9,"kb_used_meta":182454,"kb_avail":566047360,"statfs":{"total":579820584960,"available":579632496640,"internally_reserved":0,"allocated":1122304,"data_stored":1375828,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":186833575},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.997975"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.474034+0000","last_change":"2026-02-17T12:05:14.474034+0000","last_active":"2026-02-17T12:05:14.474034+0000","last_peered":"2026-02-17T12:05:14.474034+0000","last_clean":"2026-02-17T12:05:14.474034+0000","last_became_active":"2026-02-17T12:05:12.276658+0000","last_became_peered":"2026-02-17T12:05:12.276658+0000","last_unstale":"2026-02-17T12:05:14.474034+0000","last_undegraded":"2026-02-17T12:05:14.474034+0000","last_fullsized":"2026-02-17T12:05:14.474034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:42:47.843930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048223100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.478866+0000","last_change":"2026-02-17T12:05:14.478866+0000","last_active":"2026-02-17T12:05:14.478866+0000","last_peered":"2026-02-17T12:05:14.478866+0000","last_clean":"2026-02-17T12:05:14.478866+0000","last_became_active":"2026-02-17T12:05:12.278326+0000","last_became_peered":"2026-02-17T12:05:12.278326+0000","last_unstale":"2026-02-17T12:05:14.478866+0000","last_undegraded":"2026-02-17T12:05:14.478866+0000","last_fullsized":"2026-02-17T12:05:14.478866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:40:28.089270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031809399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.473914+0000","last_change":"2026-02-17T12:05:14.473914+0000","last_active":"2026-02-17T12:05:14.473914+0000","last_peered":"2026-02-17T12:05:14.473914+0000","last_clean":"2026-02-17T12:05:14.473914+0000","last_became_active":"2026-02-17T12:05:12.528026+0000","last_became_peered":"2026-02-17T12:05:12.528026+0000","last_unstale":"2026-02-17T12:05:14.473914+0000","last_undegraded":"2026-02-17T12:05:14.473914+0000","last_fullsized":"2026-02-17T12:05:14.473914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:38:50.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039251500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.478884+0000","last_change":"2026-02-17T12:05:14.478884+0000","last_active":"2026-02-17T12:05:14.478884+0000","last_peered":"2026-02-17T12:05:14.478884+0000","last_clean":"2026-02-17T12:05:14.478884+0000","last_became_active":"2026-02-17T12:05:12.529966+0000","last_became_peered":"2026-02-17T12:05:12.529966+0000","last_unstale":"2026-02-17T12:05:14.478884+0000","last_undegraded":"2026-02-17T12:05:14.478884+0000","last_fullsized":"2026-02-17T12:05:14.478884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:18:45.016861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033970499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.475335+0000","last_change":"2026-02-17T12:05:14.475335+0000","last_active":"2026-02-17T12:05:14.475335+0000","last_peered":"2026-02-17T12:05:14.475335+0000","last_clean":"2026-02-17T12:05:14.475335+0000","last_became_active":"2026-02-17T12:05:12.276436+0000","last_became_peered":"2026-02-17T12:05:12.276436+0000","last_unstale":"2026-02-17T12:05:14.475335+0000","last_undegraded":"2026-02-17T12:05:14.475335+0000","last_fullsized":"2026-02-17T12:05:14.475335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:54:19.820473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054557800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.742903+0000","last_change":"2026-02-17T12:05:14.742903+0000","last_active":"2026-02-17T12:05:14.742903+0000","last_peered":"2026-02-17T12:05:14.742903+0000","last_clean":"2026-02-17T12:05:14.742903+0000","last_became_active":"2026-02-17T12:05:12.278426+0000","last_became_peered":"2026-02-17T12:05:12.278426+0000","last_unstale":"2026-02-17T12:05:14.742903+0000","last_undegraded":"2026-02-17T12:05:14.742903+0000","last_fullsized":"2026-02-17T12:05:14.742903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:36:27.118344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032063000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.473834+0000","last_change":"2026-02-17T12:05:14.473834+0000","last_active":"2026-02-17T12:05:14.473834+0000","last_peered":"2026-02-17T12:05:14.473834+0000","last_clean":"2026-02-17T12:05:14.473834+0000","last_became_active":"2026-02-17T12:05:12.276579+0000","last_became_peered":"2026-02-17T12:05:12.276579+0000","last_unstale":"2026-02-17T12:05:14.473834+0000","last_undegraded":"2026-02-17T12:05:14.473834+0000","last_fullsized":"2026-02-17T12:05:14.473834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:36:50.953203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311976,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.474924+0000","last_change":"2026-02-17T12:05:14.475054+0000","last_active":"2026-02-17T12:05:14.474924+0000","last_peered":"2026-02-17T12:05:14.474924+0000","last_clean":"2026-02-17T12:05:14.474924+0000","last_became_active":"2026-02-17T12:05:12.276141+0000","last_became_peered":"2026-02-17T12:05:12.276141+0000","last_unstale":"2026-02-17T12:05:14.474924+0000","last_undegraded":"2026-02-17T12:05:14.474924+0000","last_fullsized":"2026-02-17T12:05:14.474924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:51:25.694043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025524199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'112","reported_seq":156,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.473460+0000","last_change":"2026-02-17T12:05:08.039772+0000","last_active":"2026-02-17T12:05:14.473460+0000","last_peered":"2026-02-17T12:05:14.473460+0000","last_clean":"2026-02-17T12:05:14.473460+0000","last_became_active":"2026-02-17T12:05:08.039610+0000","last_became_peered":"2026-02-17T12:05:08.039610+0000","last_unstale":"2026-02-17T12:05:14.473460+0000","last_undegraded":"2026-02-17T12:05:14.473460+0000","last_fullsized":"2026-02-17T12:05:14.473460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_clean_scrub_stamp":"2026-02-17T12:05:06.954552+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:26:36.107316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31296,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340544,"statfs":{"total":96636764160,"available":96604717056,"internally_reserved":0,"allocated":176128,"data_stored":55070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607556,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":163840,"data_stored":50927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607556,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":225280,"data_stored":583979,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607556,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":163840,"data_stored":50927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607556,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31296,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340544,"statfs":{"total":96636764160,"available":96604717056,"internally_reserved":0,"allocated":176128,"data_stored":55070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":217088,"data_stored":579855,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:05:18.605 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:05:18.666 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.662+0000 7f954e7d3640 10 monclient: get_monmap_and_config 2026-02-17T12:05:18.666 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.662+0000 7f954e7d3640 10 monclient: build_initial_monmap 2026-02-17T12:05:18.667 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.662+0000 7f954e7d3640 10 monclient: monmap: 2026-02-17T12:05:18.667 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:18.667 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.667 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:18.668860+0000 2026-02-17T12:05:18.667 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:18.668860+0000 2026-02-17T12:05:18.667 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:18.667 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.667 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:18.667 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:18.667 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:18.668 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:18.668 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:18.668 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.677 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 1 Processor -- start 2026-02-17T12:05:18.677 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 1 -- start start 2026-02-17T12:05:18.677 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 10 monclient: init 2026-02-17T12:05:18.678 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:18.678 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2026-02-17T12:05:18.678 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f954809c420 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:18.678 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f95480a2920 0x7f954813a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.678 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 10 monclient(hunting): picked mon.noname-a con 0x7f95480a2920 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:18.678 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f95480a2d50 0x7f954813cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.678 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 10 monclient(hunting): picked mon.noname-b con 0x7f95480a2d50 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:18.678 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f954809ffa0 con 0x7f954809c420 2026-02-17T12:05:18.678 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.678 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f954809f3e0 con 0x7f95480a2920 2026-02-17T12:05:18.679 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.679 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f954809acc0 con 0x7f95480a2d50 2026-02-17T12:05:18.679 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:18.679 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954e7d3640 10 monclient(hunting): authenticate will time out at 570.344573s 2026-02-17T12:05:18.679 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f95480a2920 0x7f954813a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.679 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954cd49640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f95480a2d50 0x7f954813cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.679 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f95480a2920 0x7f954813a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44658/0 (socket says 10.20.193.77:44658) 2026-02-17T12:05:18.679 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 1 -- 10.20.193.77:0/1442637038 learned_addr learned my addr 10.20.193.77:0/1442637038 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:18.679 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 10 monclient(hunting): get_auth_request con 0x7f95480a2920 auth_method 0 2026-02-17T12:05:18.679 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.679 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.680 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.680 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954cd49640 10 monclient(hunting): get_auth_request con 0x7f95480a2d50 auth_method 0 2026-02-17T12:05:18.680 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954cd49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.680 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954cd49640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.680 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954cd49640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.680 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.680 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.680 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.680 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954cd49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.680 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954cd49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.680 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954cd49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.680 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 10 monclient(hunting): handle_auth_done global_id 4341 payload 274 2026-02-17T12:05:18.681 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 1 -- 10.20.193.77:0/1442637038 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f95480a2d50 msgr2=0x7f954813cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:18.681 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 1 --2- 10.20.193.77:0/1442637038 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f95480a2d50 0x7f954813cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.681 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 1 -- 10.20.193.77:0/1442637038 >> v1:10.20.193.119:6789/0 conn(0x7f954809c420 legacy=0x7f95480a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:18.681 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 10 monclient: _finish_hunting 0 2026-02-17T12:05:18.681 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 1 monclient: found mon.noname-a 2026-02-17T12:05:18.681 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:18.681 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:18.681 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f95477fe640 1 -- 10.20.193.77:0/1442637038 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954809f860 con 0x7f95480a2920 2026-02-17T12:05:18.681 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.666+0000 7f954cd49640 1 --2- 10.20.193.77:0/1442637038 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f95480a2d50 0x7f954813cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:18.681 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f95477fe640 1 -- 10.20.193.77:0/1442637038 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f95480a2920 msgr2=0x7f954813a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:18.681 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f95477fe640 1 --2- 10.20.193.77:0/1442637038 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f95480a2920 0x7f954813a990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f954806ecb0 tx=0x7f953801ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a086884d41888e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.682 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9546ffd640 1 -- 10.20.193.77:0/1442637038 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95380a7cc0 con 0x7f95480a2920 2026-02-17T12:05:18.682 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9546ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.682 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9546ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:18.682 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9546ffd640 10 monclient: dump: 2026-02-17T12:05:18.682 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.682 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.682 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.682 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.682 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.682 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.682 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.683 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.683 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.683 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.683 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9546ffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:18.683 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9546ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:18.683 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9546ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:18.683 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9546ffd640 1 -- 10.20.193.77:0/1442637038 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9538004030 con 0x7f95480a2920 2026-02-17T12:05:18.683 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9546ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:18.683 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 5 monclient: authenticate success, global_id 4341 2026-02-17T12:05:18.683 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9546ffd640 1 -- 10.20.193.77:0/1442637038 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95380a7e60 con 0x7f95480a2920 2026-02-17T12:05:18.683 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:18.684 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 4 set_mon_vals no callback set 2026-02-17T12:05:18.684 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9546ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.684 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9546ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:18.684 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9546ffd640 10 monclient: dump: 2026-02-17T12:05:18.684 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.684 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.684 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.684 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.684 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.684 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.684 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.685 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.685 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.685 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient: shutdown 2026-02-17T12:05:18.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:18.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 -- 10.20.193.77:0/1442637038 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f95480a2920 msgr2=0x7f954813a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 --2- 10.20.193.77:0/1442637038 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f95480a2920 0x7f954813a990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f954806ecb0 tx=0x7f953801ee70 comp rx=0 tx=0).stop 2026-02-17T12:05:18.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 -- 10.20.193.77:0/1442637038 shutdown_connections 2026-02-17T12:05:18.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 --2- 10.20.193.77:0/1442637038 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f95480a2d50 0x7f954813cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 --2- 10.20.193.77:0/1442637038 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f95480a2920 0x7f954813a990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 -- 10.20.193.77:0/1442637038 >> 10.20.193.77:0/1442637038 conn(0x7f95480a73c0 msgr2=0x7f95480a3300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:18.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 -- 10.20.193.77:0/1442637038 shutdown_connections 2026-02-17T12:05:18.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 -- 10.20.193.77:0/1442637038 wait complete. 2026-02-17T12:05:18.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient: build_initial_monmap 2026-02-17T12:05:18.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient: monmap: 2026-02-17T12:05:18.686 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:18.686 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:18.686 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:18.686 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:18.686 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:18.686 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.686 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:18.686 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:18.687 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:18.687 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 Processor -- start 2026-02-17T12:05:18.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 -- start start 2026-02-17T12:05:18.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient: init 2026-02-17T12:05:18.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:18.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:05:18.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f954809c420 0x7f954812bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient(hunting): picked mon.noname-b con 0x7f954809c420 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:18.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f95480a2920 0x7f954812c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.688 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient(hunting): picked mon.noname-a con 0x7f95480a2920 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:18.688 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f95480a2d50 0x7f954812c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.688 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient(hunting): picked mon.noname-c con 0x7f95480a2d50 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:18.688 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.688 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f95480a0340 con 0x7f95480a2920 2026-02-17T12:05:18.688 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.688 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f95480a01c0 con 0x7f954809c420 2026-02-17T12:05:18.688 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.688 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f954809e510 con 0x7f95480a2d50 2026-02-17T12:05:18.688 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:18.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954e7d3640 10 monclient(hunting): authenticate will time out at 570.350622s 2026-02-17T12:05:18.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f95477fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f95480a2920 0x7f954812c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f95480a2d50 0x7f954812c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f95477fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f95480a2920 0x7f954812c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44672/0 (socket says 10.20.193.77:44672) 2026-02-17T12:05:18.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f95480a2d50 0x7f954812c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:51018/0 (socket says 10.20.193.77:51018) 2026-02-17T12:05:18.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f95477fe640 1 -- 10.20.193.77:0/328292426 learned_addr learned my addr 10.20.193.77:0/328292426 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:18.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f95477fe640 10 monclient(hunting): get_auth_request con 0x7f95480a2920 auth_method 0 2026-02-17T12:05:18.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f95477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f95477fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f95477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 10 monclient(hunting): get_auth_request con 0x7f95480a2d50 auth_method 0 2026-02-17T12:05:18.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f95477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f95477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f95477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9547fff640 1 --2- 10.20.193.77:0/328292426 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f954809c420 0x7f954812bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9547fff640 10 monclient(hunting): get_auth_request con 0x7f954809c420 auth_method 0 2026-02-17T12:05:18.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9547fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9547fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f9547fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 10 monclient(hunting): handle_auth_done global_id 4337 payload 824 2026-02-17T12:05:18.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 1 -- 10.20.193.77:0/328292426 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f954809c420 msgr2=0x7f954812bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 1 --2- 10.20.193.77:0/328292426 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f954809c420 0x7f954812bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 1 -- 10.20.193.77:0/328292426 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f95480a2920 msgr2=0x7f954812c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 1 --2- 10.20.193.77:0/328292426 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f95480a2920 0x7f954812c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 10 monclient: _finish_hunting 0 2026-02-17T12:05:18.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 1 monclient: found mon.noname-c 2026-02-17T12:05:18.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:18.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.670+0000 7f954cd49640 1 -- 10.20.193.77:0/328292426 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95480a5710 con 0x7f95480a2d50 2026-02-17T12:05:18.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f954cd49640 1 -- 10.20.193.77:0/328292426 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f95480a2d50 msgr2=0x7f954812c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:18.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f954cd49640 1 --2- 10.20.193.77:0/328292426 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f95480a2d50 0x7f954812c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f953c00efc0 tx=0x7f953c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 1 -- 10.20.193.77:0/328292426 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c018030 con 0x7f95480a2d50 2026-02-17T12:05:18.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:18.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 10 monclient: dump: 2026-02-17T12:05:18.692 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.692 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.692 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.693 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.693 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.693 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.693 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.693 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.693 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.693 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 10 monclient: _finish_auth 0 2026-02-17T12:05:18.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:05:18.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:18.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 1 -- 10.20.193.77:0/328292426 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953c003aa0 con 0x7f95480a2d50 2026-02-17T12:05:18.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:18.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 1 -- 10.20.193.77:0/328292426 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c004020 con 0x7f95480a2d50 2026-02-17T12:05:18.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:18.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 10 monclient: dump: 2026-02-17T12:05:18.694 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.694 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.694 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.694 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.694 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.694 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.695 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.695 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.695 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.695 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f954e7d3640 5 monclient: authenticate success, global_id 4337 2026-02-17T12:05:18.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f95467fc640 4 set_mon_vals no callback set 2026-02-17T12:05:18.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f954e7d3640 10 monclient: _renew_subs 2026-02-17T12:05:18.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f954e7d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f954e7d3640 1 -- 10.20.193.77:0/328292426 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954809d9f0 con 0x7f95480a2d50 2026-02-17T12:05:18.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f954e7d3640 10 monclient: _renew_subs 2026-02-17T12:05:18.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f954e7d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f954e7d3640 1 -- 10.20.193.77:0/328292426 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f954812ef20 con 0x7f95480a2d50 2026-02-17T12:05:18.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f954e7d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f954e7d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f954e7d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f954e7d3640 1 -- 10.20.193.77:0/328292426 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f954812eae0 con 0x7f95480a2d50 2026-02-17T12:05:18.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 1 -- 10.20.193.77:0/328292426 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f953c025060 con 0x7f95480a2d50 2026-02-17T12:05:18.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 1 --2- 10.20.193.77:0/328292426 >> v2:10.20.193.119:6800/4127986552 conn(0x7f951803a170 0x7f951803c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9544ff9640 1 -- 10.20.193.77:0/328292426 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 3530+0+0 (secure 0 0 0) 0x7f953c04e3b0 con 0x7f95480a2d50 2026-02-17T12:05:18.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9547fff640 1 --2- 10.20.193.77:0/328292426 >> v2:10.20.193.119:6800/4127986552 conn(0x7f951803a170 0x7f951803c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.697 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.674+0000 7f9547fff640 10 monclient: get_auth_request con 0x7f951803a170 auth_method 0 2026-02-17T12:05:18.697 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.678+0000 7f9544ff9640 1 -- 10.20.193.77:0/328292426 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f954809d9f0 con 0x7f95480a2d50 2026-02-17T12:05:18.697 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.678+0000 7f9544ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.697 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.678+0000 7f9544ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:18.697 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.678+0000 7f9547fff640 1 --2- 10.20.193.77:0/328292426 >> v2:10.20.193.119:6800/4127986552 conn(0x7f951803a170 0x7f951803c630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9534005030 tx=0x7f9534009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.757 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.754+0000 7f954e7d3640 1 -- 10.20.193.77:0/328292426 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f954806d670 con 0x7f951803a170 2026-02-17T12:05:18.758 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.754+0000 7f9544ff9640 1 -- 10.20.193.77:0/328292426 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34183 (secure 0 0 0) 0x7f954806d670 con 0x7f951803a170 2026-02-17T12:05:18.759 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:05:18.760 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T12:05:18.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.758+0000 7f954e7d3640 1 -- 10.20.193.77:0/328292426 >> v2:10.20.193.119:6800/4127986552 conn(0x7f951803a170 msgr2=0x7f951803c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.758+0000 7f954e7d3640 1 --2- 10.20.193.77:0/328292426 >> v2:10.20.193.119:6800/4127986552 conn(0x7f951803a170 0x7f951803c630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9534005030 tx=0x7f9534009040 comp rx=0 tx=0).stop 2026-02-17T12:05:18.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.758+0000 7f954e7d3640 10 monclient: shutdown 2026-02-17T12:05:18.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.758+0000 7f954e7d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:18.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.758+0000 7f954e7d3640 1 -- 10.20.193.77:0/328292426 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f95480a2d50 msgr2=0x7f954812c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.758+0000 7f954e7d3640 1 --2- 10.20.193.77:0/328292426 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f95480a2d50 0x7f954812c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f953c00efc0 tx=0x7f953c00c490 comp rx=0 tx=0).stop 2026-02-17T12:05:18.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.758+0000 7f954e7d3640 1 -- 10.20.193.77:0/328292426 shutdown_connections 2026-02-17T12:05:18.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.758+0000 7f954e7d3640 1 --2- 10.20.193.77:0/328292426 >> v2:10.20.193.119:6800/4127986552 conn(0x7f951803a170 0x7f951803c630 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.758+0000 7f954e7d3640 1 --2- 10.20.193.77:0/328292426 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f95480a2d50 0x7f954812c5a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.758+0000 7f954e7d3640 1 --2- 10.20.193.77:0/328292426 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f95480a2920 0x7f954812c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.758+0000 7f954e7d3640 1 --2- 10.20.193.77:0/328292426 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f954809c420 0x7f954812bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.758+0000 7f954e7d3640 1 -- 10.20.193.77:0/328292426 >> 10.20.193.77:0/328292426 conn(0x7f95480a73c0 msgr2=0x7f9548072220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:18.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.758+0000 7f954e7d3640 1 -- 10.20.193.77:0/328292426 shutdown_connections 2026-02-17T12:05:18.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.758+0000 7f954e7d3640 1 -- 10.20.193.77:0/328292426 wait complete. 2026-02-17T12:05:18.769 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2026-02-17T12:05:18.269474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":183680,"kb_used_data":1096,"kb_used_omap":9,"kb_used_meta":182454,"kb_avail":566047360,"statfs":{"total":579820584960,"available":579632496640,"internally_reserved":0,"allocated":1122304,"data_stored":1375828,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":186833575},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.997975"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.474034+0000","last_change":"2026-02-17T12:05:14.474034+0000","last_active":"2026-02-17T12:05:14.474034+0000","last_peered":"2026-02-17T12:05:14.474034+0000","last_clean":"2026-02-17T12:05:14.474034+0000","last_became_active":"2026-02-17T12:05:12.276658+0000","last_became_peered":"2026-02-17T12:05:12.276658+0000","last_unstale":"2026-02-17T12:05:14.474034+0000","last_undegraded":"2026-02-17T12:05:14.474034+0000","last_fullsized":"2026-02-17T12:05:14.474034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:42:47.843930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048223100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.478866+0000","last_change":"2026-02-17T12:05:14.478866+0000","last_active":"2026-02-17T12:05:14.478866+0000","last_peered":"2026-02-17T12:05:14.478866+0000","last_clean":"2026-02-17T12:05:14.478866+0000","last_became_active":"2026-02-17T12:05:12.278326+0000","last_became_peered":"2026-02-17T12:05:12.278326+0000","last_unstale":"2026-02-17T12:05:14.478866+0000","last_undegraded":"2026-02-17T12:05:14.478866+0000","last_fullsized":"2026-02-17T12:05:14.478866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:40:28.089270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031809399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.473914+0000","last_change":"2026-02-17T12:05:14.473914+0000","last_active":"2026-02-17T12:05:14.473914+0000","last_peered":"2026-02-17T12:05:14.473914+0000","last_clean":"2026-02-17T12:05:14.473914+0000","last_became_active":"2026-02-17T12:05:12.528026+0000","last_became_peered":"2026-02-17T12:05:12.528026+0000","last_unstale":"2026-02-17T12:05:14.473914+0000","last_undegraded":"2026-02-17T12:05:14.473914+0000","last_fullsized":"2026-02-17T12:05:14.473914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:38:50.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039251500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.478884+0000","last_change":"2026-02-17T12:05:14.478884+0000","last_active":"2026-02-17T12:05:14.478884+0000","last_peered":"2026-02-17T12:05:14.478884+0000","last_clean":"2026-02-17T12:05:14.478884+0000","last_became_active":"2026-02-17T12:05:12.529966+0000","last_became_peered":"2026-02-17T12:05:12.529966+0000","last_unstale":"2026-02-17T12:05:14.478884+0000","last_undegraded":"2026-02-17T12:05:14.478884+0000","last_fullsized":"2026-02-17T12:05:14.478884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:18:45.016861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033970499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.475335+0000","last_change":"2026-02-17T12:05:14.475335+0000","last_active":"2026-02-17T12:05:14.475335+0000","last_peered":"2026-02-17T12:05:14.475335+0000","last_clean":"2026-02-17T12:05:14.475335+0000","last_became_active":"2026-02-17T12:05:12.276436+0000","last_became_peered":"2026-02-17T12:05:12.276436+0000","last_unstale":"2026-02-17T12:05:14.475335+0000","last_undegraded":"2026-02-17T12:05:14.475335+0000","last_fullsized":"2026-02-17T12:05:14.475335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:54:19.820473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054557800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.742903+0000","last_change":"2026-02-17T12:05:14.742903+0000","last_active":"2026-02-17T12:05:14.742903+0000","last_peered":"2026-02-17T12:05:14.742903+0000","last_clean":"2026-02-17T12:05:14.742903+0000","last_became_active":"2026-02-17T12:05:12.278426+0000","last_became_peered":"2026-02-17T12:05:12.278426+0000","last_unstale":"2026-02-17T12:05:14.742903+0000","last_undegraded":"2026-02-17T12:05:14.742903+0000","last_fullsized":"2026-02-17T12:05:14.742903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:36:27.118344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032063000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.473834+0000","last_change":"2026-02-17T12:05:14.473834+0000","last_active":"2026-02-17T12:05:14.473834+0000","last_peered":"2026-02-17T12:05:14.473834+0000","last_clean":"2026-02-17T12:05:14.473834+0000","last_became_active":"2026-02-17T12:05:12.276579+0000","last_became_peered":"2026-02-17T12:05:12.276579+0000","last_unstale":"2026-02-17T12:05:14.473834+0000","last_undegraded":"2026-02-17T12:05:14.473834+0000","last_fullsized":"2026-02-17T12:05:14.473834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:36:50.953203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311976,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.474924+0000","last_change":"2026-02-17T12:05:14.475054+0000","last_active":"2026-02-17T12:05:14.474924+0000","last_peered":"2026-02-17T12:05:14.474924+0000","last_clean":"2026-02-17T12:05:14.474924+0000","last_became_active":"2026-02-17T12:05:12.276141+0000","last_became_peered":"2026-02-17T12:05:12.276141+0000","last_unstale":"2026-02-17T12:05:14.474924+0000","last_undegraded":"2026-02-17T12:05:14.474924+0000","last_fullsized":"2026-02-17T12:05:14.474924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:51:25.694043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025524199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'112","reported_seq":156,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:05:14.473460+0000","last_change":"2026-02-17T12:05:08.039772+0000","last_active":"2026-02-17T12:05:14.473460+0000","last_peered":"2026-02-17T12:05:14.473460+0000","last_clean":"2026-02-17T12:05:14.473460+0000","last_became_active":"2026-02-17T12:05:08.039610+0000","last_became_peered":"2026-02-17T12:05:08.039610+0000","last_unstale":"2026-02-17T12:05:14.473460+0000","last_undegraded":"2026-02-17T12:05:14.473460+0000","last_fullsized":"2026-02-17T12:05:14.473460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_clean_scrub_stamp":"2026-02-17T12:05:06.954552+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:26:36.107316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31296,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340544,"statfs":{"total":96636764160,"available":96604717056,"internally_reserved":0,"allocated":176128,"data_stored":55070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607556,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":163840,"data_stored":50927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607556,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":225280,"data_stored":583979,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607556,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":163840,"data_stored":50927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607556,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31296,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340544,"statfs":{"total":96636764160,"available":96604717056,"internally_reserved":0,"allocated":176128,"data_stored":55070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":217088,"data_stored":579855,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:05:18.771 INFO:tasks.mon_thrash.ceph_manager:clean! 2026-02-17T12:05:18.771 DEBUG:tasks.mon_thrash:Yielding 2026-02-17T12:05:18.771 INFO:teuthology.run_tasks:Running task exec... 2026-02-17T12:05:18.788 INFO:teuthology.task.exec:Executing custom commands... 2026-02-17T12:05:18.788 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@trial119.front.sepia.ceph.com 2026-02-17T12:05:18.789 DEBUG:teuthology.orchestra.run.trial119:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_rados_delete_pools_parallel --debug_objecter 20 --debug_ms 1 --debug_rados 20 --debug_monc 20' 2026-02-17T12:05:18.789 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2026-02-17T12:05:18.790 INFO:tasks.mon_thrash.mon_thrasher:seed: 1771329918, revive delay: 90.0, thrash delay: 1.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2026-02-17T12:05:18.790 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:05:18.790 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:05:18.850 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.846+0000 7f693393d640 10 monclient: get_monmap_and_config 2026-02-17T12:05:18.851 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.846+0000 7f693393d640 10 monclient: build_initial_monmap 2026-02-17T12:05:18.851 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.846+0000 7f693393d640 10 monclient: monmap: 2026-02-17T12:05:18.851 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:18.851 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.851 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:18.852855+0000 2026-02-17T12:05:18.851 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:18.852855+0000 2026-02-17T12:05:18.851 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:18.851 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.851 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:18.852 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:18.852 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:18.852 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:18.852 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:18.852 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.852 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.846+0000 7f693393d640 1 Processor -- start 2026-02-17T12:05:18.852 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.846+0000 7f693393d640 1 -- start start 2026-02-17T12:05:18.852 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.846+0000 7f693393d640 10 monclient: init 2026-02-17T12:05:18.854 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f693393d640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:18.854 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f693393d640 10 monclient: _add_conns ranks=[1,4,3,2,0] 2026-02-17T12:05:18.854 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f693393d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f692c09be20 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:18.854 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f693393d640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f692c0a4b40 0x7f692c0a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.855 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f693393d640 10 monclient(hunting): picked mon.noname-c con 0x7f692c0a4b40 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:18.855 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f693393d640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f692c13d2e0 0x7f692c13f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.855 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f693393d640 10 monclient(hunting): picked mon.noname-a con 0x7f692c13d2e0 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:18.855 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f693393d640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f692c09d2f0 con 0x7f692c09be20 2026-02-17T12:05:18.855 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f693393d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.855 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f693393d640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f692c135720 con 0x7f692c13d2e0 2026-02-17T12:05:18.855 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f693393d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.855 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f693393d640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f692c09d010 con 0x7f692c0a4b40 2026-02-17T12:05:18.855 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f693393d640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:18.855 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f693393d640 10 monclient(hunting): authenticate will time out at 570.528456s 2026-02-17T12:05:18.855 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f692c13d2e0 0x7f692c13f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.855 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f69316b2640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f692c09be20 0x7f692c135010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.77:51428/0 (socket says 10.20.193.77:51428) 2026-02-17T12:05:18.856 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f69316b2640 1 -- 10.20.193.77:0/3429238528 learned_addr learned my addr 10.20.193.77:0/3429238528 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:18.856 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 10 monclient(hunting): get_auth_request con 0x7f692c13d2e0 auth_method 0 2026-02-17T12:05:18.856 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.856 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.856 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.856 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6930eb1640 1 --2- 10.20.193.77:0/3429238528 >> v2:10.20.193.119:3300/0 conn(0x7f692c0a4b40 0x7f692c0a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.856 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6930eb1640 10 monclient(hunting): get_auth_request con 0x7f692c0a4b40 auth_method 0 2026-02-17T12:05:18.856 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6930eb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.856 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6930eb1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.856 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6930eb1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.856 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.856 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.857 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.857 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 10 monclient(hunting): handle_auth_done global_id 4356 payload 274 2026-02-17T12:05:18.857 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 1 -- 10.20.193.77:0/3429238528 >> v2:10.20.193.119:3300/0 conn(0x7f692c0a4b40 msgr2=0x7f692c0a4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:18.857 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 1 --2- 10.20.193.77:0/3429238528 >> v2:10.20.193.119:3300/0 conn(0x7f692c0a4b40 0x7f692c0a4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.857 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 1 -- 10.20.193.77:0/3429238528 >> v1:10.20.193.119:6789/0 conn(0x7f692c09be20 legacy=0x7f692c135010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:18.857 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 10 monclient: _finish_hunting 0 2026-02-17T12:05:18.857 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 1 monclient: found mon.noname-a 2026-02-17T12:05:18.857 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:18.857 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:18.857 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.850+0000 7f6931eb3640 1 -- 10.20.193.77:0/3429238528 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c09d5d0 con 0x7f692c13d2e0 2026-02-17T12:05:18.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6931eb3640 1 -- 10.20.193.77:0/3429238528 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f692c13d2e0 msgr2=0x7f692c13f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:18.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6931eb3640 1 --2- 10.20.193.77:0/3429238528 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f692c13d2e0 0x7f692c13f6d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f692c1358a0 tx=0x7f692801c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dcfd706991d2dab server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f691bfff640 1 -- 10.20.193.77:0/3429238528 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69280a66e0 con 0x7f692c13d2e0 2026-02-17T12:05:18.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f691bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f691bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:18.863 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f691bfff640 10 monclient: dump: 2026-02-17T12:05:18.863 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.864 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.864 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.864 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.864 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.864 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.864 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.864 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.864 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.864 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f691bfff640 10 monclient: _finish_auth 0 2026-02-17T12:05:18.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f691bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:18.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f691bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:18.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f691bfff640 1 -- 10.20.193.77:0/3429238528 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69280a6880 con 0x7f692c13d2e0 2026-02-17T12:05:18.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f691bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:18.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f691bfff640 1 -- 10.20.193.77:0/3429238528 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69280a6c50 con 0x7f692c13d2e0 2026-02-17T12:05:18.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 5 monclient: authenticate success, global_id 4356 2026-02-17T12:05:18.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:18.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 4 set_mon_vals no callback set 2026-02-17T12:05:18.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f691bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f691bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:18.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f691bfff640 10 monclient: dump: 2026-02-17T12:05:18.865 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.866 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.866 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.866 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.866 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.866 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.866 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.866 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.866 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.866 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient: shutdown 2026-02-17T12:05:18.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:18.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 -- 10.20.193.77:0/3429238528 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f692c13d2e0 msgr2=0x7f692c13f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 --2- 10.20.193.77:0/3429238528 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f692c13d2e0 0x7f692c13f6d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f692c1358a0 tx=0x7f692801c630 comp rx=0 tx=0).stop 2026-02-17T12:05:18.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 -- 10.20.193.77:0/3429238528 shutdown_connections 2026-02-17T12:05:18.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 --2- 10.20.193.77:0/3429238528 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f692c13d2e0 0x7f692c13f6d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 --2- 10.20.193.77:0/3429238528 >> v2:10.20.193.119:3300/0 conn(0x7f692c0a4b40 0x7f692c0a4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 -- 10.20.193.77:0/3429238528 >> 10.20.193.77:0/3429238528 conn(0x7f692c0aac60 msgr2=0x7f692c0ab070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:18.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 -- 10.20.193.77:0/3429238528 shutdown_connections 2026-02-17T12:05:18.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 -- 10.20.193.77:0/3429238528 wait complete. 2026-02-17T12:05:18.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient: build_initial_monmap 2026-02-17T12:05:18.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient: monmap: 2026-02-17T12:05:18.867 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:18.867 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:18.867 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:18.867 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:18.868 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:18.868 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.868 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:18.868 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:18.868 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:18.868 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.868 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 Processor -- start 2026-02-17T12:05:18.868 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 -- start start 2026-02-17T12:05:18.868 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient: init 2026-02-17T12:05:18.868 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:18.868 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:05:18.868 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f692c09be20 0x7f692c1d1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.868 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient(hunting): picked mon.noname-a con 0x7f692c09be20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:18.869 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f692c0a4b40 0x7f692c1d2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.869 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient(hunting): picked mon.noname-c con 0x7f692c0a4b40 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:18.869 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f692c13d2e0 0x7f692c1d27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.869 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient(hunting): picked mon.noname-b con 0x7f692c13d2e0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:18.869 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.869 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f692c1427c0 con 0x7f692c09be20 2026-02-17T12:05:18.869 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.869 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f692c142640 con 0x7f692c13d2e0 2026-02-17T12:05:18.869 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:18.869 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f692c142940 con 0x7f692c0a4b40 2026-02-17T12:05:18.869 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:18.869 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f693393d640 10 monclient(hunting): authenticate will time out at 570.534556s 2026-02-17T12:05:18.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f692c0a4b40 0x7f692c1d2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f69316b2640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f692c09be20 0x7f692c1d1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f692c0a4b40 0x7f692c1d2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:51034/0 (socket says 10.20.193.77:51034) 2026-02-17T12:05:18.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 1 -- 10.20.193.77:0/3267187914 learned_addr learned my addr 10.20.193.77:0/3267187914 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:18.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 10 monclient(hunting): get_auth_request con 0x7f692c0a4b40 auth_method 0 2026-02-17T12:05:18.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f69316b2640 10 monclient(hunting): get_auth_request con 0x7f692c09be20 auth_method 0 2026-02-17T12:05:18.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f69316b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:18.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f69316b2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:18.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f69316b2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:18.870 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f69316b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:18.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f69316b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:18.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f69316b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:18.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 10 monclient(hunting): handle_auth_done global_id 4349 payload 824 2026-02-17T12:05:18.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 1 -- 10.20.193.77:0/3267187914 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f692c13d2e0 msgr2=0x7f692c1d27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 1 --2- 10.20.193.77:0/3267187914 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f692c13d2e0 0x7f692c1d27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 1 -- 10.20.193.77:0/3267187914 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f692c09be20 msgr2=0x7f692c1d1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 1 --2- 10.20.193.77:0/3267187914 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f692c09be20 0x7f692c1d1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 10 monclient: _finish_hunting 0 2026-02-17T12:05:18.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 1 monclient: found mon.noname-c 2026-02-17T12:05:18.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:18.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.854+0000 7f6930eb1640 1 -- 10.20.193.77:0/3267187914 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c13c1f0 con 0x7f692c0a4b40 2026-02-17T12:05:18.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6930eb1640 1 -- 10.20.193.77:0/3267187914 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f692c0a4b40 msgr2=0x7f692c1d2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:18.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6930eb1640 1 --2- 10.20.193.77:0/3267187914 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f692c0a4b40 0x7f692c1d2290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f692000d790 tx=0x7f692000dc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 1 -- 10.20.193.77:0/3267187914 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6920018020 con 0x7f692c0a4b40 2026-02-17T12:05:18.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:18.872 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 10 monclient: dump: 2026-02-17T12:05:18.872 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.872 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.873 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.873 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.873 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.873 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.873 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.873 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.873 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.873 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.873 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:18.873 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:18.873 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:18.873 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 1 -- 10.20.193.77:0/3267187914 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692000ba60 con 0x7f692c0a4b40 2026-02-17T12:05:18.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:18.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 1 -- 10.20.193.77:0/3267187914 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692000be30 con 0x7f692c0a4b40 2026-02-17T12:05:18.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:18.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:18.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 10 monclient: dump: 2026-02-17T12:05:18.874 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:18.874 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:18.874 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.874 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:18.874 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:18.874 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:18.874 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:18.874 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:18.875 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:18.875 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:18.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f691b7fe640 4 set_mon_vals no callback set 2026-02-17T12:05:18.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f693393d640 5 monclient: authenticate success, global_id 4349 2026-02-17T12:05:18.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f693393d640 10 monclient: _renew_subs 2026-02-17T12:05:18.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f693393d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f693393d640 1 -- 10.20.193.77:0/3267187914 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f692c0a69e0 con 0x7f692c0a4b40 2026-02-17T12:05:18.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f693393d640 10 monclient: _renew_subs 2026-02-17T12:05:18.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f693393d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f693393d640 1 -- 10.20.193.77:0/3267187914 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f692c13cbf0 con 0x7f692c0a4b40 2026-02-17T12:05:18.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f693393d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f693393d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f693393d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f693393d640 1 -- 10.20.193.77:0/3267187914 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f692c0a4f50 con 0x7f692c0a4b40 2026-02-17T12:05:18.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 1 -- 10.20.193.77:0/3267187914 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f6920013050 con 0x7f692c0a4b40 2026-02-17T12:05:18.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 1 --2- 10.20.193.77:0/3267187914 >> v2:10.20.193.119:6800/4127986552 conn(0x7f68fc03a170 0x7f68fc03c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:18.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f6919ffb640 1 -- 10.20.193.77:0/3267187914 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 3530+0+0 (secure 0 0 0) 0x7f692004df10 con 0x7f692c0a4b40 2026-02-17T12:05:18.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f69316b2640 1 --2- 10.20.193.77:0/3267187914 >> v2:10.20.193.119:6800/4127986552 conn(0x7f68fc03a170 0x7f68fc03c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:18.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.858+0000 7f69316b2640 10 monclient: get_auth_request con 0x7f68fc03a170 auth_method 0 2026-02-17T12:05:18.877 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.862+0000 7f69316b2640 1 --2- 10.20.193.77:0/3267187914 >> v2:10.20.193.119:6800/4127986552 conn(0x7f68fc03a170 0x7f68fc03c630 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f691c007da0 tx=0x7f691c007cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:18.877 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.862+0000 7f6919ffb640 1 -- 10.20.193.77:0/3267187914 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f6920022020 con 0x7f692c0a4b40 2026-02-17T12:05:18.877 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.862+0000 7f6919ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:18.877 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.862+0000 7f6919ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:18.970 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.966+0000 7f693393d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:05:18.970 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.966+0000 7f693393d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:18.970 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.966+0000 7f693393d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:18.970 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.966+0000 7f693393d640 1 -- 10.20.193.77:0/3267187914 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f692c13a540 con 0x7f692c0a4b40 2026-02-17T12:05:18.971 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.966+0000 7f6919ffb640 1 -- 10.20.193.77:0/3267187914 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f69200145f0 con 0x7f692c0a4b40 2026-02-17T12:05:18.971 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.966+0000 7f6919ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:18.971 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.966+0000 7f6919ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:18.971 INFO:teuthology.orchestra.run.trial077.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"093d53f2-7cd0-4506-a27d-4c950e190615","modified":"2026-02-17T12:04:22.035180Z","created":"2026-02-17T12:04:22.035180Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:3300","nonce":0},{"type":"v1","addr":"10.20.193.77:6789","nonce":0}]},"addr":"10.20.193.77:6789/0","public_addr":"10.20.193.77:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:3300","nonce":0},{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:3301","nonce":0},{"type":"v1","addr":"10.20.193.77:6790","nonce":0}]},"addr":"10.20.193.77:6790/0","public_addr":"10.20.193.77:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:05:18.972 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.966+0000 7f693393d640 1 -- 10.20.193.77:0/3267187914 >> v2:10.20.193.119:6800/4127986552 conn(0x7f68fc03a170 msgr2=0x7f68fc03c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.972 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.966+0000 7f693393d640 1 --2- 10.20.193.77:0/3267187914 >> v2:10.20.193.119:6800/4127986552 conn(0x7f68fc03a170 0x7f68fc03c630 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f691c007da0 tx=0x7f691c007cf0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.966+0000 7f693393d640 10 monclient: shutdown 2026-02-17T12:05:18.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.966+0000 7f693393d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:18.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.966+0000 7f693393d640 1 -- 10.20.193.77:0/3267187914 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f692c0a4b40 msgr2=0x7f692c1d2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:18.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.966+0000 7f693393d640 1 --2- 10.20.193.77:0/3267187914 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f692c0a4b40 0x7f692c1d2290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f692000d790 tx=0x7f692000dc50 comp rx=0 tx=0).stop 2026-02-17T12:05:18.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.970+0000 7f693393d640 1 -- 10.20.193.77:0/3267187914 shutdown_connections 2026-02-17T12:05:18.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.970+0000 7f693393d640 1 --2- 10.20.193.77:0/3267187914 >> v2:10.20.193.119:6800/4127986552 conn(0x7f68fc03a170 0x7f68fc03c630 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.970+0000 7f693393d640 1 --2- 10.20.193.77:0/3267187914 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f692c13d2e0 0x7f692c1d27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.970+0000 7f693393d640 1 --2- 10.20.193.77:0/3267187914 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f692c0a4b40 0x7f692c1d2290 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.970+0000 7f693393d640 1 --2- 10.20.193.77:0/3267187914 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f692c09be20 0x7f692c1d1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:18.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.970+0000 7f693393d640 1 -- 10.20.193.77:0/3267187914 >> 10.20.193.77:0/3267187914 conn(0x7f692c0aac60 msgr2=0x7f692c0a6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:18.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.970+0000 7f693393d640 1 -- 10.20.193.77:0/3267187914 shutdown_connections 2026-02-17T12:05:18.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:18.970+0000 7f693393d640 1 -- 10.20.193.77:0/3267187914 wait complete. 2026-02-17T12:05:18.981 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:05:18.981 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-17T12:05:18.981 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:05:18.981 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:05:19.042 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.038+0000 7f79de5aa640 10 monclient: get_monmap_and_config 2026-02-17T12:05:19.042 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.038+0000 7f79de5aa640 10 monclient: build_initial_monmap 2026-02-17T12:05:19.042 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.038+0000 7f79de5aa640 10 monclient: monmap: 2026-02-17T12:05:19.042 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:19.042 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.043 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:19.044640+0000 2026-02-17T12:05:19.043 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:19.044640+0000 2026-02-17T12:05:19.043 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:19.043 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.043 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:19.043 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:19.043 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:19.043 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:19.043 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:19.043 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.046 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.038+0000 7f79de5aa640 1 Processor -- start 2026-02-17T12:05:19.046 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.038+0000 7f79de5aa640 1 -- start start 2026-02-17T12:05:19.046 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.038+0000 7f79de5aa640 10 monclient: init 2026-02-17T12:05:19.046 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79de5aa640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:19.046 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79de5aa640 10 monclient: _add_conns ranks=[0,4,2,1,3] 2026-02-17T12:05:19.046 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79de5aa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f79d809be20 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:19.046 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79de5aa640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f79d80a4c20 0x7f79d813d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.046 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79de5aa640 10 monclient(hunting): picked mon.noname-c con 0x7f79d80a4c20 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:19.047 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79de5aa640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f79d80a5070 0x7f79d813f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.047 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79de5aa640 10 monclient(hunting): picked mon.noname-b con 0x7f79d80a5070 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:19.047 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79de5aa640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79d8135530 con 0x7f79d809be20 2026-02-17T12:05:19.047 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79de5aa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.047 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79de5aa640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f79d809c200 con 0x7f79d80a4c20 2026-02-17T12:05:19.047 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79de5aa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.047 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79de5aa640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f79d809cdf0 con 0x7f79d80a5070 2026-02-17T12:05:19.047 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79de5aa640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:19.047 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79de5aa640 10 monclient(hunting): authenticate will time out at 570.720477s 2026-02-17T12:05:19.047 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79d7fff640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f79d809be20 0x7f79d8134e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42466/0 (socket says 10.20.193.77:42466) 2026-02-17T12:05:19.047 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79d7fff640 1 -- 10.20.193.77:0/3508561832 learned_addr learned my addr 10.20.193.77:0/3508561832 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:19.047 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 1 --2- 10.20.193.77:0/3508561832 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f79d80a5070 0x7f79d813f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.048 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 10 monclient(hunting): get_auth_request con 0x7f79d80a5070 auth_method 0 2026-02-17T12:05:19.048 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.048 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.048 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.048 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79d77fe640 1 --2- 10.20.193.77:0/3508561832 >> v2:10.20.193.119:3300/0 conn(0x7f79d80a4c20 0x7f79d813d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.048 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79d77fe640 10 monclient(hunting): get_auth_request con 0x7f79d80a4c20 auth_method 0 2026-02-17T12:05:19.048 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.048 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.048 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.048 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.048 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.048 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.048 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.049 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.049 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.049 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 10 monclient(hunting): handle_auth_done global_id 4352 payload 274 2026-02-17T12:05:19.049 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 1 -- 10.20.193.77:0/3508561832 >> v2:10.20.193.119:3300/0 conn(0x7f79d80a4c20 msgr2=0x7f79d813d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:19.049 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 1 --2- 10.20.193.77:0/3508561832 >> v2:10.20.193.119:3300/0 conn(0x7f79d80a4c20 0x7f79d813d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.049 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 1 -- 10.20.193.77:0/3508561832 >> v1:10.20.193.77:6789/0 conn(0x7f79d809be20 legacy=0x7f79d8134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:19.049 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 10 monclient: _finish_hunting 0 2026-02-17T12:05:19.049 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 1 monclient: found mon.noname-b 2026-02-17T12:05:19.049 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:19.049 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:05:19.049 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.042+0000 7f79dcb20640 1 -- 10.20.193.77:0/3508561832 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d809d0d0 con 0x7f79d80a5070 2026-02-17T12:05:19.055 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79dcb20640 1 -- 10.20.193.77:0/3508561832 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f79d80a5070 msgr2=0x7f79d813f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:19.055 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79dcb20640 1 --2- 10.20.193.77:0/3508561832 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f79d80a5070 0x7f79d813f9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009d90 tx=0x7f79cc01c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65b62d1d9fc0d39a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.055 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d6ffd640 1 -- 10.20.193.77:0/3508561832 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc0b2070 con 0x7f79d80a5070 2026-02-17T12:05:19.055 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.056 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:05:19.056 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d6ffd640 10 monclient: dump: 2026-02-17T12:05:19.056 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.056 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.056 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.056 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.056 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.056 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.056 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.056 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.056 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.056 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.057 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d6ffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:19.057 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d6ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:19.057 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:19.057 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d6ffd640 1 -- 10.20.193.77:0/3508561832 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79cc0a57a0 con 0x7f79d80a5070 2026-02-17T12:05:19.057 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:19.057 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d6ffd640 1 -- 10.20.193.77:0/3508561832 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc0a5b70 con 0x7f79d80a5070 2026-02-17T12:05:19.057 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 5 monclient: authenticate success, global_id 4352 2026-02-17T12:05:19.057 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:19.057 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 4 set_mon_vals no callback set 2026-02-17T12:05:19.057 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.057 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:19.057 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d6ffd640 10 monclient: dump: 2026-02-17T12:05:19.058 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.058 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.058 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.058 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.058 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.058 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.058 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.058 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.058 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.058 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.058 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient: shutdown 2026-02-17T12:05:19.058 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:19.058 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 -- 10.20.193.77:0/3508561832 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f79d80a5070 msgr2=0x7f79d813f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.059 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 --2- 10.20.193.77:0/3508561832 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f79d80a5070 0x7f79d813f9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009d90 tx=0x7f79cc01c850 comp rx=0 tx=0).stop 2026-02-17T12:05:19.059 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 -- 10.20.193.77:0/3508561832 shutdown_connections 2026-02-17T12:05:19.059 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 --2- 10.20.193.77:0/3508561832 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f79d80a5070 0x7f79d813f9c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.059 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 --2- 10.20.193.77:0/3508561832 >> v2:10.20.193.119:3300/0 conn(0x7f79d80a4c20 0x7f79d813d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.059 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 -- 10.20.193.77:0/3508561832 >> 10.20.193.77:0/3508561832 conn(0x7f79d8074ba0 msgr2=0x7f79d80aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:19.059 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 -- 10.20.193.77:0/3508561832 shutdown_connections 2026-02-17T12:05:19.059 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 -- 10.20.193.77:0/3508561832 wait complete. 2026-02-17T12:05:19.059 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient: build_initial_monmap 2026-02-17T12:05:19.059 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient: monmap: 2026-02-17T12:05:19.059 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:19.059 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:19.059 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:19.060 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:19.060 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:19.060 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.060 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:19.060 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:19.060 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:19.060 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.060 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 Processor -- start 2026-02-17T12:05:19.060 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 -- start start 2026-02-17T12:05:19.060 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient: init 2026-02-17T12:05:19.060 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:19.060 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:05:19.060 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f79d809be20 0x7f79d813e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.061 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient(hunting): picked mon.noname-c con 0x7f79d809be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:19.061 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f79d80a4c20 0x7f79d813e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.061 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient(hunting): picked mon.noname-b con 0x7f79d80a4c20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:19.061 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d80a5070 0x7f79d813eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.061 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient(hunting): picked mon.noname-a con 0x7f79d80a5070 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:19.061 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.061 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f79d8142ab0 con 0x7f79d80a5070 2026-02-17T12:05:19.061 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.061 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f79d8142930 con 0x7f79d80a4c20 2026-02-17T12:05:19.061 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.061 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f79d8142c30 con 0x7f79d809be20 2026-02-17T12:05:19.061 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:19.062 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79de5aa640 10 monclient(hunting): authenticate will time out at 570.726100s 2026-02-17T12:05:19.062 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f79d809be20 0x7f79d813e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.062 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f79d809be20 0x7f79d813e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:51052/0 (socket says 10.20.193.77:51052) 2026-02-17T12:05:19.062 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 1 -- 10.20.193.77:0/997964566 learned_addr learned my addr 10.20.193.77:0/997964566 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:19.062 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 10 monclient(hunting): get_auth_request con 0x7f79d809be20 auth_method 0 2026-02-17T12:05:19.062 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.062 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.062 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.062 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79dcb20640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d80a5070 0x7f79d813eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.062 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.062 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.062 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.063 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79dcb20640 10 monclient(hunting): get_auth_request con 0x7f79d80a5070 auth_method 0 2026-02-17T12:05:19.063 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79dcb20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.063 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79dcb20640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.063 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79dcb20640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.063 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79dcb20640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.063 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79dcb20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.063 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79dcb20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.063 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 10 monclient(hunting): handle_auth_done global_id 4355 payload 824 2026-02-17T12:05:19.063 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 1 -- 10.20.193.77:0/997964566 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f79d80a4c20 msgr2=0x7f79d813e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.063 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f79d80a4c20 0x7f79d813e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.063 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 1 -- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d80a5070 msgr2=0x7f79d813eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.063 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d80a5070 0x7f79d813eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.064 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 10 monclient: _finish_hunting 0 2026-02-17T12:05:19.064 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 1 monclient: found mon.noname-c 2026-02-17T12:05:19.064 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:19.064 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:19.064 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.046+0000 7f79d7fff640 1 -- 10.20.193.77:0/997964566 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d809e5e0 con 0x7f79d809be20 2026-02-17T12:05:19.064 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d7fff640 1 -- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f79d809be20 msgr2=0x7f79d813e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:19.064 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d7fff640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f79d809be20 0x7f79d813e0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f79c400c570 tx=0x7f79c400ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.064 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 1 -- 10.20.193.77:0/997964566 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4007070 con 0x7f79d809be20 2026-02-17T12:05:19.064 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.065 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:19.065 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 10 monclient: dump: 2026-02-17T12:05:19.065 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.065 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.065 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.065 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.065 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.065 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.065 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.065 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.065 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.065 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.066 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 10 monclient: _finish_auth 0 2026-02-17T12:05:19.066 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:05:19.066 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:19.066 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 1 -- 10.20.193.77:0/997964566 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c4007210 con 0x7f79d809be20 2026-02-17T12:05:19.066 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:19.066 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 1 -- 10.20.193.77:0/997964566 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4007600 con 0x7f79d809be20 2026-02-17T12:05:19.066 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.066 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:19.066 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 10 monclient: dump: 2026-02-17T12:05:19.066 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.066 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.067 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.067 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.067 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.067 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.067 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.067 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.067 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.067 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.067 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79de5aa640 5 monclient: authenticate success, global_id 4355 2026-02-17T12:05:19.067 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d67fc640 4 set_mon_vals no callback set 2026-02-17T12:05:19.067 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79de5aa640 10 monclient: _renew_subs 2026-02-17T12:05:19.067 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79de5aa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:19.067 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79de5aa640 1 -- 10.20.193.77:0/997964566 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d80a8ad0 con 0x7f79d809be20 2026-02-17T12:05:19.068 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79de5aa640 10 monclient: _renew_subs 2026-02-17T12:05:19.068 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79de5aa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:19.068 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79de5aa640 1 -- 10.20.193.77:0/997964566 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d80a9000 con 0x7f79d809be20 2026-02-17T12:05:19.068 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79de5aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:19.068 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79de5aa640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d1fa0 0x7f79d81d2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.068 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79de5aa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.068 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79de5aa640 1 -- 10.20.193.77:0/997964566 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f79d809fd20 con 0x7f79d81d1fa0 2026-02-17T12:05:19.068 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 1 -- 10.20.193.77:0/997964566 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f79c401b400 con 0x7f79d809be20 2026-02-17T12:05:19.068 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d77fe640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d1fa0 0x7f79d81d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.068 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d77fe640 10 monclient: get_auth_request con 0x7f79d81d1fa0 auth_method 0 2026-02-17T12:05:19.068 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.068 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.069 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.069 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.069 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.069 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.069 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 1 --2- 10.20.193.77:0/997964566 >> v2:10.20.193.119:6800/4127986552 conn(0x7f79a803a120 0x7f79a803c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.069 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 1 -- 10.20.193.77:0/997964566 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 3530+0+0 (secure 0 0 0) 0x7f79c404d6f0 con 0x7f79d809be20 2026-02-17T12:05:19.069 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d77fe640 10 monclient(hunting): handle_auth_done global_id 4365 payload 824 2026-02-17T12:05:19.069 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d77fe640 1 -- 10.20.193.77:0/997964566 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79d8134e00 con 0x7f79d81d1fa0 2026-02-17T12:05:19.069 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79dcb20640 1 --2- 10.20.193.77:0/997964566 >> v2:10.20.193.119:6800/4127986552 conn(0x7f79a803a120 0x7f79a803c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.069 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79dcb20640 10 monclient: get_auth_request con 0x7f79a803a120 auth_method 0 2026-02-17T12:05:19.069 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d77fe640 1 -- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d1fa0 msgr2=0x7f79d81d2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:19.069 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d77fe640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d1fa0 0x7f79d81d2380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79d813f890 tx=0x7f79c800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.070 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 1 -- 10.20.193.77:0/997964566 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c8017070 con 0x7f79d81d1fa0 2026-02-17T12:05:19.070 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.070 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:19.070 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 10 monclient: dump: 2026-02-17T12:05:19.070 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.070 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.070 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.070 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.070 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.070 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.070 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.070 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.070 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.071 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.071 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 1 -- 10.20.193.77:0/997964566 <== mon.0 v2:10.20.193.77:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f79c800cb40 con 0x7f79d81d1fa0 2026-02-17T12:05:19.071 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:19.071 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:19.071 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 1 -- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d1fa0 msgr2=0x7f79d81d2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.071 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d1fa0 0x7f79d81d2380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79d813f890 tx=0x7f79c800ecd0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.071 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 1 -- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d1fa0 msgr2=0x7f79d81d2380 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:19.071 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.050+0000 7f79d4ff9640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d1fa0 0x7f79d81d2380 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79d813f890 tx=0x7f79c800ecd0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.071 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79dcb20640 1 --2- 10.20.193.77:0/997964566 >> v2:10.20.193.119:6800/4127986552 conn(0x7f79a803a120 0x7f79a803c5e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0ac000 tx=0x7f79cc0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.073 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79de5aa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:19.074 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79de5aa640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d28c0 0x7f79d81dd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.074 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79de5aa640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.074 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79de5aa640 1 -- 10.20.193.77:0/997964566 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f79d813fc90 con 0x7f79d81d28c0 2026-02-17T12:05:19.074 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79d77fe640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d28c0 0x7f79d81dd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.074 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79d77fe640 10 monclient: get_auth_request con 0x7f79d81d28c0 auth_method 0 2026-02-17T12:05:19.074 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.074 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.074 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.074 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.074 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.074 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.075 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79d77fe640 10 monclient(hunting): handle_auth_done global_id 4368 payload 824 2026-02-17T12:05:19.075 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.054+0000 7f79d77fe640 1 -- 10.20.193.77:0/997964566 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f79d8069020 con 0x7f79d81d28c0 2026-02-17T12:05:19.075 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79d77fe640 1 -- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d28c0 msgr2=0x7f79d81dd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:19.075 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79d77fe640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d28c0 0x7f79d81dd2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f79d813f890 tx=0x7f79c80047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.075 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79d4ff9640 1 -- 10.20.193.77:0/997964566 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c8017030 con 0x7f79d81d28c0 2026-02-17T12:05:19.075 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.075 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79d4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:19.075 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79d4ff9640 10 monclient: dump: 2026-02-17T12:05:19.075 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.075 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.075 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.075 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.076 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.076 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.076 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.076 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.076 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.076 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.076 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79d4ff9640 1 -- 10.20.193.77:0/997964566 <== mon.0 v2:10.20.193.77:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4709 (secure 0 0 0) 0x7f79c8004550 con 0x7f79d81d28c0 2026-02-17T12:05:19.076 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79d4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:19.076 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79d4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:19.076 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79d4ff9640 1 -- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d28c0 msgr2=0x7f79d81dd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.076 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79d4ff9640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d28c0 0x7f79d81dd2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f79d813f890 tx=0x7f79c80047d0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.076 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79d4ff9640 1 -- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d28c0 msgr2=0x7f79d81dd2f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:19.076 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79d4ff9640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f79d81d28c0 0x7f79d81dd2f0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f79d813f890 tx=0x7f79c80047d0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.077 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T12:05:19.077 INFO:teuthology.orchestra.run.trial077.stdout: "name": "a", 2026-02-17T12:05:19.077 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 0, 2026-02-17T12:05:19.077 INFO:teuthology.orchestra.run.trial077.stdout: "state": "leader", 2026-02-17T12:05:19.077 INFO:teuthology.orchestra.run.trial077.stdout: "election_epoch": 8, 2026-02-17T12:05:19.077 INFO:teuthology.orchestra.run.trial077.stdout: "uptime": 31035, 2026-02-17T12:05:19.077 INFO:teuthology.orchestra.run.trial077.stdout: "quorum": [ 2026-02-17T12:05:19.077 INFO:teuthology.orchestra.run.trial077.stdout: 0, 2026-02-17T12:05:19.077 INFO:teuthology.orchestra.run.trial077.stdout: 1, 2026-02-17T12:05:19.078 INFO:teuthology.orchestra.run.trial077.stdout: 2 2026-02-17T12:05:19.078 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.078 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_age": 25, 2026-02-17T12:05:19.078 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:05:19.078 INFO:teuthology.orchestra.run.trial077.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:19.078 INFO:teuthology.orchestra.run.trial077.stdout: "required_mon": [ 2026-02-17T12:05:19.078 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:19.078 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:19.078 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:19.078 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_mon": [ 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:19.079 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: "outside_quorum": [], 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: "extra_probe_peers": [], 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: "sync_provider": [], 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: "monmap": { 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: "epoch": 1, 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: "fsid": "093d53f2-7cd0-4506-a27d-4c950e190615", 2026-02-17T12:05:19.080 INFO:teuthology.orchestra.run.trial077.stdout: "modified": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "created": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release": 19, 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "election_strategy": 1, 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "disallowed_leaders": "", 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false, 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "removed_ranks": "", 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "persistent": [ 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:19.081 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: "optional": [] 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: "mons": [ 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 0, 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: "name": "a", 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.082 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3300", 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789", 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789/0", 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6789/0", 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.083 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 1, 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: "name": "b", 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:3300", 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789", 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.084 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789/0", 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 2, 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: "name": "c", 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3301", 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:19.085 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790", 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790/0", 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6790/0", 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: "feature_map": { 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: "mon": [ 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:19.086 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: "osd": [ 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: "num": 3 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: "client": [ 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false 2026-02-17T12:05:19.087 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T12:05:19.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79de5aa640 1 -- 10.20.193.77:0/997964566 >> v2:10.20.193.119:6800/4127986552 conn(0x7f79a803a120 msgr2=0x7f79a803c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79de5aa640 1 --2- 10.20.193.77:0/997964566 >> v2:10.20.193.119:6800/4127986552 conn(0x7f79a803a120 0x7f79a803c5e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0ac000 tx=0x7f79cc0a7070 comp rx=0 tx=0).stop 2026-02-17T12:05:19.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79de5aa640 10 monclient: shutdown 2026-02-17T12:05:19.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79de5aa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:19.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79de5aa640 1 -- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f79d809be20 msgr2=0x7f79d813e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79de5aa640 1 --2- 10.20.193.77:0/997964566 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f79d809be20 0x7f79d813e0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f79c400c570 tx=0x7f79c400ca30 comp rx=0 tx=0).stop 2026-02-17T12:05:19.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79dcb20640 1 -- 10.20.193.77:0/997964566 reap_dead start 2026-02-17T12:05:19.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79dcb20640 1 -- 10.20.193.77:0/997964566 reap_dead start 2026-02-17T12:05:19.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79de5aa640 1 -- 10.20.193.77:0/997964566 shutdown_connections 2026-02-17T12:05:19.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79de5aa640 1 -- 10.20.193.77:0/997964566 >> 10.20.193.77:0/997964566 conn(0x7f79d8074ba0 msgr2=0x7f79d80aabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:19.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79de5aa640 1 -- 10.20.193.77:0/997964566 shutdown_connections 2026-02-17T12:05:19.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.058+0000 7f79de5aa640 1 -- 10.20.193.77:0/997964566 wait complete. 2026-02-17T12:05:19.089 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:05:19.090 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:05:19.090 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:05:19.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 10 monclient: get_monmap_and_config 2026-02-17T12:05:19.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 10 monclient: build_initial_monmap 2026-02-17T12:05:19.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 10 monclient: monmap: 2026-02-17T12:05:19.153 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:19.153 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.153 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:19.155296+0000 2026-02-17T12:05:19.153 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:19.155296+0000 2026-02-17T12:05:19.153 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:19.153 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.153 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:19.154 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:19.154 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:19.154 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:19.154 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:19.154 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.156 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 1 Processor -- start 2026-02-17T12:05:19.156 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 1 -- start start 2026-02-17T12:05:19.156 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 10 monclient: init 2026-02-17T12:05:19.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:19.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 10 monclient: _add_conns ranks=[1,0,3,2,4] 2026-02-17T12:05:19.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f68f40a5430 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:19.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f68f40a5f20 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:19.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f68f413ef60 0x7f68f4141350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 10 monclient(hunting): picked mon.noname-a con 0x7f68f413ef60 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:19.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f40a7050 con 0x7f68f40a5f20 2026-02-17T12:05:19.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f409d250 con 0x7f68f40a5430 2026-02-17T12:05:19.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f68f40a44e0 con 0x7f68f413ef60 2026-02-17T12:05:19.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:19.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68fb774640 10 monclient(hunting): authenticate will time out at 570.830828s 2026-02-17T12:05:19.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f8ce8640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f68f40a5f20 0x7f68f413d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42472/0 (socket says 10.20.193.77:42472) 2026-02-17T12:05:19.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f8ce8640 1 -- 10.20.193.77:0/4112090202 learned_addr learned my addr 10.20.193.77:0/4112090202 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:19.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 1 --2- 10.20.193.77:0/4112090202 >> v2:10.20.193.77:3300/0 conn(0x7f68f413ef60 0x7f68f4141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 10 monclient(hunting): get_auth_request con 0x7f68f413ef60 auth_method 0 2026-02-17T12:05:19.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 10 monclient(hunting): handle_auth_done global_id 4371 payload 274 2026-02-17T12:05:19.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 1 -- 10.20.193.77:0/4112090202 >> v1:10.20.193.119:6789/0 conn(0x7f68f40a5430 legacy=0x7f68f40a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:19.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 1 -- 10.20.193.77:0/4112090202 >> v1:10.20.193.77:6789/0 conn(0x7f68f40a5f20 legacy=0x7f68f413d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:19.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 10 monclient: _finish_hunting 0 2026-02-17T12:05:19.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 1 monclient: found mon.noname-a 2026-02-17T12:05:19.159 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:19.159 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:19.159 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.150+0000 7f68f9cea640 1 -- 10.20.193.77:0/4112090202 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f40a6950 con 0x7f68f413ef60 2026-02-17T12:05:19.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68f9cea640 1 -- 10.20.193.77:0/4112090202 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f68f413ef60 msgr2=0x7f68f4141350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:19.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68f9cea640 1 --2- 10.20.193.77:0/4112090202 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f68f413ef60 0x7f68f4141350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f68f40abc80 tx=0x7f68f001c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1ddd87fcff01db server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68e3fff640 1 -- 10.20.193.77:0/4112090202 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f00ac070 con 0x7f68f413ef60 2026-02-17T12:05:19.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68e3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:19.164 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68e3fff640 10 monclient: dump: 2026-02-17T12:05:19.164 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.164 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.165 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.165 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.165 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.165 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.165 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.165 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.165 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.165 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68e3fff640 10 monclient: _finish_auth 0 2026-02-17T12:05:19.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68e3fff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:19.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:19.165 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68e3fff640 1 -- 10.20.193.77:0/4112090202 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f00a6760 con 0x7f68f413ef60 2026-02-17T12:05:19.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68e3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:19.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68e3fff640 1 -- 10.20.193.77:0/4112090202 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f00a6b30 con 0x7f68f413ef60 2026-02-17T12:05:19.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68fb774640 5 monclient: authenticate success, global_id 4371 2026-02-17T12:05:19.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68fb774640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:19.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68fb774640 4 set_mon_vals no callback set 2026-02-17T12:05:19.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68e3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:19.166 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68e3fff640 10 monclient: dump: 2026-02-17T12:05:19.166 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.166 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.166 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.166 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.167 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.167 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.167 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.167 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.167 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.167 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68fb774640 10 monclient: shutdown 2026-02-17T12:05:19.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68fb774640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:19.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68fb774640 1 -- 10.20.193.77:0/4112090202 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f68f413ef60 msgr2=0x7f68f4141350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68fb774640 1 --2- 10.20.193.77:0/4112090202 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f68f413ef60 0x7f68f4141350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f68f40abc80 tx=0x7f68f001c810 comp rx=0 tx=0).stop 2026-02-17T12:05:19.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68fb774640 1 -- 10.20.193.77:0/4112090202 shutdown_connections 2026-02-17T12:05:19.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68fb774640 1 --2- 10.20.193.77:0/4112090202 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f68f413ef60 0x7f68f4141350 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68fb774640 1 -- 10.20.193.77:0/4112090202 >> 10.20.193.77:0/4112090202 conn(0x7f68f40aac30 msgr2=0x7f68f40ab040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:19.167 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68fb774640 1 -- 10.20.193.77:0/4112090202 shutdown_connections 2026-02-17T12:05:19.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68fb774640 1 -- 10.20.193.77:0/4112090202 wait complete. 2026-02-17T12:05:19.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68fb774640 10 monclient: build_initial_monmap 2026-02-17T12:05:19.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.154+0000 7f68fb774640 10 monclient: monmap: 2026-02-17T12:05:19.168 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:19.168 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:19.168 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:19.168 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:19.168 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:19.168 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.168 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:19.168 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:19.168 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:19.168 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.168 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 1 Processor -- start 2026-02-17T12:05:19.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 1 -- start start 2026-02-17T12:05:19.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient: init 2026-02-17T12:05:19.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:19.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:05:19.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f40a5430 0x7f68f41d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient(hunting): picked mon.noname-c con 0x7f68f40a5430 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:19.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f68f40a5f20 0x7f68f40a3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient(hunting): picked mon.noname-a con 0x7f68f40a5f20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:19.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f68f413ef60 0x7f68f40a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient(hunting): picked mon.noname-b con 0x7f68f413ef60 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:19.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f68f409c7c0 con 0x7f68f40a5f20 2026-02-17T12:05:19.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.169 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f68f409c640 con 0x7f68f413ef60 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f68f41444c0 con 0x7f68f40a5430 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient(hunting): authenticate will time out at 570.836424s 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f68f40a5f20 0x7f68f40a3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f68f40a5f20 0x7f68f40a3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44740/0 (socket says 10.20.193.77:44740) 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 1 -- 10.20.193.77:0/1477494552 learned_addr learned my addr 10.20.193.77:0/1477494552 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 10 monclient(hunting): get_auth_request con 0x7f68f40a5f20 auth_method 0 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f40a5430 0x7f68f41d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient(hunting): get_auth_request con 0x7f68f40a5430 auth_method 0 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.170 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f9cea640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f68f413ef60 0x7f68f40a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f9cea640 10 monclient(hunting): get_auth_request con 0x7f68f413ef60 auth_method 0 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f9cea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f9cea640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f9cea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 10 monclient(hunting): handle_auth_done global_id 4374 payload 824 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 1 -- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f40a5430 msgr2=0x7f68f41d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f40a5430 0x7f68f41d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.171 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 1 -- 10.20.193.77:0/1477494552 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f68f413ef60 msgr2=0x7f68f40a3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f68f413ef60 0x7f68f40a3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 10 monclient: _finish_hunting 0 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 1 monclient: found mon.noname-a 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 1 -- 10.20.193.77:0/1477494552 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f40a0030 con 0x7f68f40a5f20 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 1 -- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f68f40a5f20 msgr2=0x7f68f40a3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f8ce8640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f68f40a5f20 0x7f68f40a3560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f68e800c570 tx=0x7f68e800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68e1ffb640 1 -- 10.20.193.77:0/1477494552 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8007070 con 0x7f68f40a5f20 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68e1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68e1ffb640 10 monclient: dump: 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.172 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68e1ffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68e1ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68e1ffb640 1 -- 10.20.193.77:0/1477494552 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e8007210 con 0x7f68f40a5f20 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68e1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68e1ffb640 1 -- 10.20.193.77:0/1477494552 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8007600 con 0x7f68f40a5f20 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68e1ffb640 10 monclient: dump: 2026-02-17T12:05:19.173 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.174 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.174 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.174 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.174 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.174 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.174 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.174 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.174 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.174 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68e37fe640 4 set_mon_vals no callback set 2026-02-17T12:05:19.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 5 monclient: authenticate success, global_id 4374 2026-02-17T12:05:19.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient: _renew_subs 2026-02-17T12:05:19.174 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 1 -- 10.20.193.77:0/1477494552 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f409e620 con 0x7f68f40a5f20 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient: _renew_subs 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 1 -- 10.20.193.77:0/1477494552 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f413f690 con 0x7f68f40a5f20 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f409fc10 0x7f68f413d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68fb774640 1 -- 10.20.193.77:0/1477494552 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f68f40a3fe0 con 0x7f68f409fc10 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f409fc10 0x7f68f413d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient: get_auth_request con 0x7f68f409fc10 auth_method 0 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 10 monclient(hunting): handle_auth_done global_id 4361 payload 824 2026-02-17T12:05:19.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.158+0000 7f68f94e9640 1 -- 10.20.193.77:0/1477494552 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68f41d2e10 con 0x7f68f409fc10 2026-02-17T12:05:19.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68e1ffb640 1 -- 10.20.193.77:0/1477494552 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f68e801b400 con 0x7f68f40a5f20 2026-02-17T12:05:19.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68e1ffb640 1 --2- 10.20.193.77:0/1477494552 >> v2:10.20.193.119:6800/4127986552 conn(0x7f68c403a1a0 0x7f68c403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68e1ffb640 1 -- 10.20.193.77:0/1477494552 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3530+0+0 (secure 0 0 0) 0x7f68e804d610 con 0x7f68f40a5f20 2026-02-17T12:05:19.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68f9cea640 1 --2- 10.20.193.77:0/1477494552 >> v2:10.20.193.119:6800/4127986552 conn(0x7f68c403a1a0 0x7f68c403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68f9cea640 10 monclient: get_auth_request con 0x7f68c403a1a0 auth_method 0 2026-02-17T12:05:19.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68f94e9640 1 -- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f409fc10 msgr2=0x7f68f413d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:19.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68f94e9640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f409fc10 0x7f68f413d230 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68e400f770 tx=0x7f68e400fc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68e1ffb640 1 -- 10.20.193.77:0/1477494552 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e400d7a0 con 0x7f68f409fc10 2026-02-17T12:05:19.178 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68e1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:19.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68e1ffb640 10 monclient: dump: 2026-02-17T12:05:19.179 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.179 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.179 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.179 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.179 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.179 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.179 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.179 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.179 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.179 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.179 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68e1ffb640 1 -- 10.20.193.77:0/1477494552 <== mon.2 v2:10.20.193.77:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f68e4019070 con 0x7f68f409fc10 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68e1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68e1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68e1ffb640 1 -- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f409fc10 msgr2=0x7f68f413d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68e1ffb640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f409fc10 0x7f68f413d230 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68e400f770 tx=0x7f68e400fc30 comp rx=0 tx=0).stop 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68e1ffb640 1 -- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f409fc10 msgr2=0x7f68f413d230 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68e1ffb640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f409fc10 0x7f68f413d230 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68e400f770 tx=0x7f68e400fc30 comp rx=0 tx=0).stop 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.162+0000 7f68f9cea640 1 --2- 10.20.193.77:0/1477494552 >> v2:10.20.193.119:6800/4127986552 conn(0x7f68c403a1a0 0x7f68c403c660 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f68f00ab000 tx=0x7f68f00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.166+0000 7f68fb774640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.166+0000 7f68fb774640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f4136810 0x7f68f41dd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.166+0000 7f68fb774640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.166+0000 7f68fb774640 1 -- 10.20.193.77:0/1477494552 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f68f409f820 con 0x7f68f4136810 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.166+0000 7f68f94e9640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f4136810 0x7f68f41dd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.166+0000 7f68f94e9640 10 monclient: get_auth_request con 0x7f68f4136810 auth_method 0 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.166+0000 7f68f94e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.180 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.166+0000 7f68f94e9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.166+0000 7f68f94e9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.166+0000 7f68f94e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.166+0000 7f68f94e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.166+0000 7f68f94e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.166+0000 7f68f94e9640 10 monclient(hunting): handle_auth_done global_id 4364 payload 824 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.166+0000 7f68f94e9640 1 -- 10.20.193.77:0/1477494552 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f68f4069020 con 0x7f68f4136810 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68f94e9640 1 -- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f4136810 msgr2=0x7f68f41dd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68f94e9640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f4136810 0x7f68f41dd9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f68e400f770 tx=0x7f68e4003870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68e1ffb640 1 -- 10.20.193.77:0/1477494552 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4006e40 con 0x7f68f4136810 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68e1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68e1ffb640 10 monclient: dump: 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.181 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.182 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.182 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.182 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.182 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.182 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68e1ffb640 1 -- 10.20.193.77:0/1477494552 <== mon.2 v2:10.20.193.77:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7f68e400d9b0 con 0x7f68f4136810 2026-02-17T12:05:19.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68e1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:19.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68e1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:19.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68e1ffb640 1 -- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f4136810 msgr2=0x7f68f41dd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68e1ffb640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f4136810 0x7f68f41dd9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f68e400f770 tx=0x7f68e4003870 comp rx=0 tx=0).stop 2026-02-17T12:05:19.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68e1ffb640 1 -- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f4136810 msgr2=0x7f68f41dd9c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:19.182 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68e1ffb640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f68f4136810 0x7f68f41dd9c0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f68e400f770 tx=0x7f68e4003870 comp rx=0 tx=0).stop 2026-02-17T12:05:19.183 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T12:05:19.183 INFO:teuthology.orchestra.run.trial077.stdout: "name": "c", 2026-02-17T12:05:19.183 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 2, 2026-02-17T12:05:19.183 INFO:teuthology.orchestra.run.trial077.stdout: "state": "peon", 2026-02-17T12:05:19.183 INFO:teuthology.orchestra.run.trial077.stdout: "election_epoch": 8, 2026-02-17T12:05:19.183 INFO:teuthology.orchestra.run.trial077.stdout: "uptime": 31135, 2026-02-17T12:05:19.183 INFO:teuthology.orchestra.run.trial077.stdout: "quorum": [ 2026-02-17T12:05:19.183 INFO:teuthology.orchestra.run.trial077.stdout: 0, 2026-02-17T12:05:19.183 INFO:teuthology.orchestra.run.trial077.stdout: 1, 2026-02-17T12:05:19.183 INFO:teuthology.orchestra.run.trial077.stdout: 2 2026-02-17T12:05:19.183 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_age": 25, 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "required_mon": [ 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:19.184 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_mon": [ 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.185 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "outside_quorum": [], 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "extra_probe_peers": [], 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "sync_provider": [], 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "monmap": { 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "epoch": 1, 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "fsid": "093d53f2-7cd0-4506-a27d-4c950e190615", 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "modified": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "created": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release": 19, 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "election_strategy": 1, 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "disallowed_leaders": "", 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false, 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "removed_ranks": "", 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:05:19.186 INFO:teuthology.orchestra.run.trial077.stdout: "persistent": [ 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: "optional": [] 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: "mons": [ 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.187 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 0, 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: "name": "a", 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3300", 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789", 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789/0", 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6789/0", 2026-02-17T12:05:19.188 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 1, 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: "name": "b", 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:3300", 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789", 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.189 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789/0", 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 2, 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: "name": "c", 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3301", 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.190 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790", 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790/0", 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6790/0", 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: "feature_map": { 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: "mon": [ 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:19.191 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:05:19.192 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.192 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.192 INFO:teuthology.orchestra.run.trial077.stdout: "client": [ 2026-02-17T12:05:19.192 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.192 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:19.192 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:19.192 INFO:teuthology.orchestra.run.trial077.stdout: "num": 3 2026-02-17T12:05:19.192 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.192 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.192 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.192 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false 2026-02-17T12:05:19.192 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T12:05:19.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68fb774640 1 -- 10.20.193.77:0/1477494552 >> v2:10.20.193.119:6800/4127986552 conn(0x7f68c403a1a0 msgr2=0x7f68c403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68fb774640 1 --2- 10.20.193.77:0/1477494552 >> v2:10.20.193.119:6800/4127986552 conn(0x7f68c403a1a0 0x7f68c403c660 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f68f00ab000 tx=0x7f68f00a7000 comp rx=0 tx=0).stop 2026-02-17T12:05:19.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68fb774640 10 monclient: shutdown 2026-02-17T12:05:19.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68fb774640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:19.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68fb774640 1 -- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f68f40a5f20 msgr2=0x7f68f40a3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68fb774640 1 --2- 10.20.193.77:0/1477494552 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f68f40a5f20 0x7f68f40a3560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f68e800c570 tx=0x7f68e800ca30 comp rx=0 tx=0).stop 2026-02-17T12:05:19.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68f9cea640 1 -- 10.20.193.77:0/1477494552 reap_dead start 2026-02-17T12:05:19.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68f9cea640 1 -- 10.20.193.77:0/1477494552 reap_dead start 2026-02-17T12:05:19.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68fb774640 1 -- 10.20.193.77:0/1477494552 shutdown_connections 2026-02-17T12:05:19.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68fb774640 1 -- 10.20.193.77:0/1477494552 >> 10.20.193.77:0/1477494552 conn(0x7f68f40aac30 msgr2=0x7f68f4140ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:19.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68fb774640 1 -- 10.20.193.77:0/1477494552 shutdown_connections 2026-02-17T12:05:19.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.170+0000 7f68fb774640 1 -- 10.20.193.77:0/1477494552 wait complete. 2026-02-17T12:05:19.194 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:05:19.194 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:05:19.194 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:05:19.254 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.250+0000 7fda2ba2d640 10 monclient: get_monmap_and_config 2026-02-17T12:05:19.254 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.250+0000 7fda2ba2d640 10 monclient: build_initial_monmap 2026-02-17T12:05:19.254 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.250+0000 7fda2ba2d640 10 monclient: monmap: 2026-02-17T12:05:19.254 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:19.254 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.255 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:19.257156+0000 2026-02-17T12:05:19.255 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:19.257156+0000 2026-02-17T12:05:19.255 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:19.255 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.255 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:19.255 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:19.255 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:19.255 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:19.255 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:19.255 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 1 Processor -- start 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 1 -- start start 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 10 monclient: init 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fda2409be20 0x7fda24134e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 10 monclient(hunting): picked mon.noname-a con 0x7fda2409be20 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fda240a4c20 0x7fda241380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 10 monclient(hunting): picked mon.noname-c con 0x7fda240a4c20 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fda240a5070 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda2409cdf0 con 0x7fda240a5070 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fda2409c200 con 0x7fda2409be20 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fda2409d0d0 con 0x7fda240a4c20 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda2ba2d640 10 monclient(hunting): authenticate will time out at 570.932571s 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fda2409be20 0x7fda24134e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda29fa3640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7fda240a5070 0x7fda24138630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:42478/0 (socket says 10.20.193.77:42478) 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 10 monclient(hunting): get_auth_request con 0x7fda2409be20 auth_method 0 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda29fa3640 1 -- 10.20.193.77:0/189546289 learned_addr learned my addr 10.20.193.77:0/189546289 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:19.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda28fa1640 1 --2- 10.20.193.77:0/189546289 >> v2:10.20.193.119:3300/0 conn(0x7fda240a4c20 0x7fda241380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda28fa1640 10 monclient(hunting): get_auth_request con 0x7fda240a4c20 auth_method 0 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda28fa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda28fa1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda28fa1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 10 monclient(hunting): handle_auth_done global_id 4377 payload 274 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 1 -- 10.20.193.77:0/189546289 >> v2:10.20.193.119:3300/0 conn(0x7fda240a4c20 msgr2=0x7fda241380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 1 --2- 10.20.193.77:0/189546289 >> v2:10.20.193.119:3300/0 conn(0x7fda240a4c20 0x7fda241380f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 1 -- 10.20.193.77:0/189546289 >> v1:10.20.193.77:6789/0 conn(0x7fda240a5070 legacy=0x7fda24138630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 10 monclient: _finish_hunting 0 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 1 monclient: found mon.noname-a 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:19.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.254+0000 7fda297a2640 1 -- 10.20.193.77:0/189546289 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2409d3b0 con 0x7fda2409be20 2026-02-17T12:05:19.258 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda297a2640 1 -- 10.20.193.77:0/189546289 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fda2409be20 msgr2=0x7fda24134e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:19.258 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda297a2640 1 --2- 10.20.193.77:0/189546289 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fda2409be20 0x7fda24134e20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fda240a7cb0 tx=0x7fda1401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4614a959d4a30eda server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda13fff640 1 -- 10.20.193.77:0/189546289 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda140b0070 con 0x7fda2409be20 2026-02-17T12:05:19.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda13fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:19.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda13fff640 10 monclient: dump: 2026-02-17T12:05:19.259 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.259 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.259 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.259 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.259 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.259 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.259 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.259 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda13fff640 10 monclient: _finish_auth 0 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda13fff640 10 monclient: _check_auth_tickets 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda13fff640 1 -- 10.20.193.77:0/189546289 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda140ab600 con 0x7fda2409be20 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda13fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda13fff640 1 -- 10.20.193.77:0/189546289 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda140ab9d0 con 0x7fda2409be20 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 5 monclient: authenticate success, global_id 4377 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 4 set_mon_vals no callback set 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda13fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda13fff640 10 monclient: dump: 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient: shutdown 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 -- 10.20.193.77:0/189546289 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fda2409be20 msgr2=0x7fda24134e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 --2- 10.20.193.77:0/189546289 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fda2409be20 0x7fda24134e20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fda240a7cb0 tx=0x7fda1401c460 comp rx=0 tx=0).stop 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 -- 10.20.193.77:0/189546289 shutdown_connections 2026-02-17T12:05:19.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 --2- 10.20.193.77:0/189546289 >> v2:10.20.193.119:3300/0 conn(0x7fda240a4c20 0x7fda241380f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.261 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 --2- 10.20.193.77:0/189546289 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fda2409be20 0x7fda24134e20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.261 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 -- 10.20.193.77:0/189546289 >> 10.20.193.77:0/189546289 conn(0x7fda24074ba0 msgr2=0x7fda240aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:19.261 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 -- 10.20.193.77:0/189546289 shutdown_connections 2026-02-17T12:05:19.261 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 -- 10.20.193.77:0/189546289 wait complete. 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient: build_initial_monmap 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient: monmap: 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 Processor -- start 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 -- start start 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient: init 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda2409be20 0x7fda2413e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient(hunting): picked mon.noname-b con 0x7fda2409be20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fda240a4c20 0x7fda2413e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient(hunting): picked mon.noname-c con 0x7fda240a4c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:19.262 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fda240a5070 0x7fda2413eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient(hunting): picked mon.noname-a con 0x7fda240a5070 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fda24138f50 con 0x7fda240a5070 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fda24142ec0 con 0x7fda2409be20 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fda24143040 con 0x7fda240a4c20 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda2ba2d640 10 monclient(hunting): authenticate will time out at 570.937805s 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fda240a5070 0x7fda2413eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fda240a5070 0x7fda2413eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:44756/0 (socket says 10.20.193.77:44756) 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 1 -- 10.20.193.77:0/2131788279 learned_addr learned my addr 10.20.193.77:0/2131788279 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 10 monclient(hunting): get_auth_request con 0x7fda240a5070 auth_method 0 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda28fa1640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fda240a4c20 0x7fda2413e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda28fa1640 10 monclient(hunting): get_auth_request con 0x7fda240a4c20 auth_method 0 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda28fa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda28fa1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda28fa1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda297a2640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda2409be20 0x7fda2413e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda297a2640 10 monclient(hunting): get_auth_request con 0x7fda2409be20 auth_method 0 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda297a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda297a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda297a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda28fa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.263 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda28fa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda28fa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 10 monclient(hunting): handle_auth_done global_id 4380 payload 824 2026-02-17T12:05:19.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 1 -- 10.20.193.77:0/2131788279 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fda240a4c20 msgr2=0x7fda2413e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fda240a4c20 0x7fda2413e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 1 -- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda2409be20 msgr2=0x7fda2413e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda2409be20 0x7fda2413e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:19.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 10 monclient: _finish_hunting 0 2026-02-17T12:05:19.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 1 monclient: found mon.noname-a 2026-02-17T12:05:19.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:19.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:19.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda29fa3640 1 -- 10.20.193.77:0/2131788279 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2409f700 con 0x7fda240a5070 2026-02-17T12:05:19.264 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.258+0000 7fda297a2640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda2409be20 0x7fda2413e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:05:19.265 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda29fa3640 1 -- 10.20.193.77:0/2131788279 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fda240a5070 msgr2=0x7fda2413eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:19.265 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda29fa3640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fda240a5070 0x7fda2413eb80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fda2000cb20 tx=0x7fda2000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.265 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 1 -- 10.20.193.77:0/2131788279 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20012400 con 0x7fda240a5070 2026-02-17T12:05:19.265 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.265 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:19.265 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 10 monclient: dump: 2026-02-17T12:05:19.265 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.265 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.265 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.265 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.265 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.265 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 1 -- 10.20.193.77:0/2131788279 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda200125a0 con 0x7fda240a5070 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 1 -- 10.20.193.77:0/2131788279 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20012990 con 0x7fda240a5070 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 10 monclient: dump: 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda137fe640 4 set_mon_vals no callback set 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda2ba2d640 5 monclient: authenticate success, global_id 4380 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda2ba2d640 10 monclient: _renew_subs 2026-02-17T12:05:19.266 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda2ba2d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda2ba2d640 1 -- 10.20.193.77:0/2131788279 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda240a48b0 con 0x7fda240a5070 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda2ba2d640 10 monclient: _renew_subs 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda2ba2d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda2ba2d640 1 -- 10.20.193.77:0/2131788279 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda2409e250 con 0x7fda240a5070 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda2ba2d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda2ba2d640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2120 0x7fda241d2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda2ba2d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda2ba2d640 1 -- 10.20.193.77:0/2131788279 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fda24135570 con 0x7fda241d2120 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 1 -- 10.20.193.77:0/2131788279 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fda20012b70 con 0x7fda240a5070 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda297a2640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2120 0x7fda241d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda297a2640 10 monclient: get_auth_request con 0x7fda241d2120 auth_method 0 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda297a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda297a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda297a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 1 --2- 10.20.193.77:0/2131788279 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd9f403a170 0x7fd9f403c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda11ffb640 1 -- 10.20.193.77:0/2131788279 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3530+0+0 (secure 0 0 0) 0x7fda2004de90 con 0x7fda240a5070 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda28fa1640 1 --2- 10.20.193.77:0/2131788279 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd9f403a170 0x7fd9f403c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda297a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda297a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda297a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda28fa1640 10 monclient: get_auth_request con 0x7fd9f403a170 auth_method 0 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda297a2640 10 monclient(hunting): handle_auth_done global_id 4330 payload 824 2026-02-17T12:05:19.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda297a2640 1 -- 10.20.193.77:0/2131788279 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda2413fd60 con 0x7fda241d2120 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.262+0000 7fda28fa1640 1 --2- 10.20.193.77:0/2131788279 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd9f403a170 0x7fd9f403c630 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fda2413f960 tx=0x7fda18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda297a2640 1 -- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2120 msgr2=0x7fda241d2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda297a2640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2120 0x7fda241d2500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fda240aba30 tx=0x7fda14019200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda11ffb640 1 -- 10.20.193.77:0/2131788279 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda140b0040 con 0x7fda241d2120 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda11ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda11ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda11ffb640 10 monclient: dump: 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda11ffb640 1 -- 10.20.193.77:0/2131788279 <== mon.1 v2:10.20.193.119:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fda140b5450 con 0x7fda241d2120 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda11ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda11ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda11ffb640 1 -- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2120 msgr2=0x7fda241d2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda11ffb640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2120 0x7fda241d2500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fda240aba30 tx=0x7fda14019200 comp rx=0 tx=0).stop 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda11ffb640 1 -- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2120 msgr2=0x7fda241d2500 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:19.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda11ffb640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2120 0x7fda241d2500 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fda240aba30 tx=0x7fda14019200 comp rx=0 tx=0).stop 2026-02-17T12:05:19.270 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda2ba2d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:19.270 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda2ba2d640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2a40 0x7fda241dd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:19.270 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda2ba2d640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:19.270 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda2ba2d640 1 -- 10.20.193.77:0/2131788279 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fda24134e00 con 0x7fda241d2a40 2026-02-17T12:05:19.270 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda297a2640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2a40 0x7fda241dd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:19.270 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda297a2640 10 monclient: get_auth_request con 0x7fda241d2a40 auth_method 0 2026-02-17T12:05:19.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda297a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:19.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.266+0000 7fda297a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:19.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda297a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:19.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda297a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:19.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda297a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:19.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda297a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:19.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda297a2640 10 monclient(hunting): handle_auth_done global_id 4333 payload 824 2026-02-17T12:05:19.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda297a2640 1 -- 10.20.193.77:0/2131788279 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fda24069020 con 0x7fda241d2a40 2026-02-17T12:05:19.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda297a2640 1 -- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2a40 msgr2=0x7fda241dd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:19.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda297a2640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2a40 0x7fda241dd470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fda1401a090 tx=0x7fda14009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:19.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda11ffb640 1 -- 10.20.193.77:0/2131788279 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda140b0040 con 0x7fda241d2a40 2026-02-17T12:05:19.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda11ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:19.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda11ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:05:19.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda11ffb640 10 monclient: dump: 2026-02-17T12:05:19.273 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:19.273 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:19.273 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.273 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:19.273 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:19.273 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:19.273 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda11ffb640 1 -- 10.20.193.77:0/2131788279 <== mon.1 v2:10.20.193.119:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4874 (secure 0 0 0) 0x7fda140c23c0 con 0x7fda241d2a40 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda11ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda11ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda11ffb640 1 -- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2a40 msgr2=0x7fda241dd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda11ffb640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2a40 0x7fda241dd470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fda1401a090 tx=0x7fda14009290 comp rx=0 tx=0).stop 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda11ffb640 1 -- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2a40 msgr2=0x7fda241dd470 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda11ffb640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fda241d2a40 0x7fda241dd470 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fda1401a090 tx=0x7fda14009290 comp rx=0 tx=0).stop 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stdout: "name": "b", 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 1, 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stdout: "state": "peon", 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stdout: "election_epoch": 8, 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stdout: "uptime": 31211, 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stdout: "quorum": [ 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stdout: 0, 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stdout: 1, 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stdout: 2 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.274 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_age": 25, 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: "required_mon": [ 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:19.275 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_mon": [ 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.276 INFO:teuthology.orchestra.run.trial077.stdout: "outside_quorum": [], 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "extra_probe_peers": [], 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "sync_provider": [], 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "monmap": { 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "epoch": 1, 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "fsid": "093d53f2-7cd0-4506-a27d-4c950e190615", 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "modified": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "created": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release": 19, 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "election_strategy": 1, 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "disallowed_leaders": "", 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false, 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "removed_ranks": "", 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:05:19.277 INFO:teuthology.orchestra.run.trial077.stdout: "persistent": [ 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "optional": [] 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "mons": [ 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 0, 2026-02-17T12:05:19.278 INFO:teuthology.orchestra.run.trial077.stdout: "name": "a", 2026-02-17T12:05:19.279 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:19.279 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:19.279 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.279 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:19.279 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3300", 2026-02-17T12:05:19.279 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.279 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.279 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.279 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:19.279 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789", 2026-02-17T12:05:19.279 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.279 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789/0", 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6789/0", 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 1, 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: "name": "b", 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:3300", 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.280 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789", 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789/0", 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 2, 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: "name": "c", 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:19.281 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3301", 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790", 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790/0", 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6790/0", 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: "feature_map": { 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: "mon": [ 2026-02-17T12:05:19.282 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: "osd": [ 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: "num": 3 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: "client": [ 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: "num": 5 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: "mgr": [ 2026-02-17T12:05:19.283 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:19.284 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:19.284 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:19.284 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:05:19.284 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:19.284 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:19.284 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:19.284 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false 2026-02-17T12:05:19.284 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T12:05:19.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda2ba2d640 1 -- 10.20.193.77:0/2131788279 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd9f403a170 msgr2=0x7fd9f403c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda2ba2d640 1 --2- 10.20.193.77:0/2131788279 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd9f403a170 0x7fd9f403c630 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fda2413f960 tx=0x7fda18008040 comp rx=0 tx=0).stop 2026-02-17T12:05:19.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda2ba2d640 10 monclient: shutdown 2026-02-17T12:05:19.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda2ba2d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:19.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda2ba2d640 1 -- 10.20.193.77:0/2131788279 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fda240a5070 msgr2=0x7fda2413eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:19.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda2ba2d640 1 --2- 10.20.193.77:0/2131788279 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fda240a5070 0x7fda2413eb80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fda2000cb20 tx=0x7fda2000a060 comp rx=0 tx=0).stop 2026-02-17T12:05:19.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda29fa3640 1 -- 10.20.193.77:0/2131788279 reap_dead start 2026-02-17T12:05:19.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda29fa3640 1 -- 10.20.193.77:0/2131788279 reap_dead start 2026-02-17T12:05:19.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda2ba2d640 1 -- 10.20.193.77:0/2131788279 shutdown_connections 2026-02-17T12:05:19.285 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda2ba2d640 1 -- 10.20.193.77:0/2131788279 >> 10.20.193.77:0/2131788279 conn(0x7fda24074ba0 msgr2=0x7fda24137ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:19.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda2ba2d640 1 -- 10.20.193.77:0/2131788279 shutdown_connections 2026-02-17T12:05:19.286 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:19.270+0000 7fda2ba2d640 1 -- 10.20.193.77:0/2131788279 wait complete. 2026-02-17T12:05:19.286 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:05:19.286 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-17T12:05:19.286 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2026-02-17T12:05:19.286 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-17T12:05:19.286 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T12:05:19.286 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T12:05:19.286 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:05:19.299 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T12:05:19.299 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-17T12:05:19.299 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-17T12:05:19.299 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T12:05:34.300 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-17T12:05:34.301 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-17T12:05:34.301 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-17T12:05:34.301 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:05:34.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 10 monclient: get_monmap_and_config 2026-02-17T12:05:34.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 10 monclient: build_initial_monmap 2026-02-17T12:05:34.374 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 10 monclient: monmap: 2026-02-17T12:05:34.374 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:34.375 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:34.375 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:34.374753+0000 2026-02-17T12:05:34.375 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:34.374753+0000 2026-02-17T12:05:34.375 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:34.375 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:34.375 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:34.375 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:34.375 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:34.375 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:34.375 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:34.375 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:34.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 1 Processor -- start 2026-02-17T12:05:34.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 1 -- start start 2026-02-17T12:05:34.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 10 monclient: init 2026-02-17T12:05:34.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:34.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 10 monclient: _add_conns ranks=[2,0,1,3,4] 2026-02-17T12:05:34.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 0x7fea0c09d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:34.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 10 monclient(hunting): picked mon.noname-b con 0x7fea0c0a1fc0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:34.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fea0c0a23a0 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:34.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fea0c13d5a0 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:34.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea0c09c7c0 con 0x7fea0c0a23a0 2026-02-17T12:05:34.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea0c09caa0 con 0x7fea0c13d5a0 2026-02-17T12:05:34.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:34.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fea0c09cd80 con 0x7fea0c0a1fc0 2026-02-17T12:05:34.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:34.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea12ec3640 10 monclient(hunting): authenticate will time out at 586.050162s 2026-02-17T12:05:34.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea10c38640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 0x7fea0c09d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:34.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea03fff640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7fea0c0a23a0 0x7fea0c0a27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:40144/0 (socket says 10.20.193.77:40144) 2026-02-17T12:05:34.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea11439640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7fea0c13d5a0 legacy=0x7fea0c13f990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T12:05:34.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea03fff640 1 -- 10.20.193.77:0/323354323 learned_addr learned my addr 10.20.193.77:0/323354323 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:34.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea10c38640 10 monclient(hunting): get_auth_request con 0x7fea0c0a1fc0 auth_method 0 2026-02-17T12:05:34.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea10c38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:34.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea10c38640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:34.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea10c38640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:34.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 msgr2=0x7fea0c09d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:05:34.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 msgr2=0x7fea0c09d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:34.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 0x7fea0c09d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:34.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.370+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 0x7fea0c09d8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:34.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.374+0000 7fea03fff640 1 -- 10.20.193.77:0/323354323 >> v1:10.20.193.77:6789/0 conn(0x7fea0c0a23a0 legacy=0x7fea0c0a27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:34.574 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.574+0000 7fea11439640 1 -- 10.20.193.77:0/323354323 >> v1:10.20.193.119:6789/0 conn(0x7fea0c13d5a0 legacy=0x7fea0c13f990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T12:05:34.574 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.574+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 0x7fea0c09d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:34.574 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.574+0000 7fea10c38640 10 monclient(hunting): get_auth_request con 0x7fea0c0a1fc0 auth_method 0 2026-02-17T12:05:34.574 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.574+0000 7fea10c38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:34.574 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.574+0000 7fea10c38640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:34.574 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.574+0000 7fea10c38640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:34.574 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.574+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 msgr2=0x7fea0c09d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:05:34.574 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.574+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 msgr2=0x7fea0c09d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:34.574 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.574+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 0x7fea0c09d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:34.574 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.574+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 0x7fea0c09d8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:05:34.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.978+0000 7fea11439640 1 -- 10.20.193.77:0/323354323 >> v1:10.20.193.119:6789/0 conn(0x7fea0c13d5a0 legacy=0x7fea0c13f990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T12:05:34.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.978+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 0x7fea0c09d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:34.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.978+0000 7fea10c38640 10 monclient(hunting): get_auth_request con 0x7fea0c0a1fc0 auth_method 0 2026-02-17T12:05:34.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.978+0000 7fea10c38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:34.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.978+0000 7fea10c38640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:34.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.978+0000 7fea10c38640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:34.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.978+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 msgr2=0x7fea0c09d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:05:34.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.978+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 msgr2=0x7fea0c09d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:34.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.978+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 0x7fea0c09d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:34.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:34.978+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 0x7fea0c09d8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:05:35.784 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:35.782+0000 7fea11439640 1 -- 10.20.193.77:0/323354323 >> v1:10.20.193.119:6789/0 conn(0x7fea0c13d5a0 legacy=0x7fea0c13f990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T12:05:35.784 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:35.782+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 0x7fea0c09d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:35.784 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:35.782+0000 7fea10c38640 10 monclient(hunting): get_auth_request con 0x7fea0c0a1fc0 auth_method 0 2026-02-17T12:05:35.784 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:35.782+0000 7fea10c38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:35.785 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:35.782+0000 7fea10c38640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:35.785 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:35.782+0000 7fea10c38640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:35.785 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:35.782+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 msgr2=0x7fea0c09d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T12:05:35.785 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:35.782+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 msgr2=0x7fea0c09d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:35.785 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:35.782+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 0x7fea0c09d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:35.785 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:35.782+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 0x7fea0c09d8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:05:37.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 10 monclient(hunting): tick 2026-02-17T12:05:37.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:05:37.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 1 monclient(hunting): continuing hunt 2026-02-17T12:05:37.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:05:37.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 1 -- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 msgr2=0x7fea0c09d8c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:37.375 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fea0c0a1fc0 0x7fea0c09d8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:37.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 1 -- 10.20.193.77:0/323354323 >> v1:10.20.193.119:6789/0 conn(0x7fea0c13d5a0 legacy=0x7fea0c13f990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:37.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 1 -- 10.20.193.77:0/323354323 >> v1:10.20.193.77:6789/0 conn(0x7fea0c0a23a0 legacy=0x7fea0c0a27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:37.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 10 monclient: _add_conns ranks=[4,3] 2026-02-17T12:05:37.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.119:3300/0 conn(0x7fe9f0003860 0x7fe9f0005ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:37.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 10 monclient(hunting): picked mon.noname-c con 0x7fe9f0003860 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:37.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 0x7fe9f0008870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:37.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 10 monclient(hunting): picked mon.noname-a con 0x7fe9f00063d0 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:37.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:37.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 1 -- 10.20.193.77:0/323354323 --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fea0c09cd80 con 0x7fe9f00063d0 2026-02-17T12:05:37.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:37.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 1 -- 10.20.193.77:0/323354323 --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe9f0008f30 con 0x7fe9f0003860 2026-02-17T12:05:37.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea027fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:37.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> v2:10.20.193.119:3300/0 conn(0x7fe9f0003860 msgr2=0x7fe9f0005ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T12:05:37.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea03fff640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 0x7fe9f0008870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:37.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.119:3300/0 conn(0x7fe9f0003860 0x7fe9f0005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:37.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea03fff640 10 monclient(hunting): get_auth_request con 0x7fe9f00063d0 auth_method 0 2026-02-17T12:05:37.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:37.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea03fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:37.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea03fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:37.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea03fff640 1 -- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 msgr2=0x7fe9f0008870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:05:37.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea03fff640 1 -- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 msgr2=0x7fe9f0008870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:37.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea03fff640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 0x7fe9f0008870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:37.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.370+0000 7fea03fff640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 0x7fe9f0008870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:37.576 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.574+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> v2:10.20.193.119:3300/0 conn(0x7fe9f0003860 msgr2=0x7fe9f0005ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T12:05:37.576 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.574+0000 7fea03fff640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 0x7fe9f0008870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:37.576 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.574+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.119:3300/0 conn(0x7fe9f0003860 0x7fe9f0005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:05:37.576 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.574+0000 7fea03fff640 10 monclient(hunting): get_auth_request con 0x7fe9f00063d0 auth_method 0 2026-02-17T12:05:37.577 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.574+0000 7fea03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:37.577 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.574+0000 7fea03fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:37.577 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.574+0000 7fea03fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:37.577 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.574+0000 7fea03fff640 1 -- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 msgr2=0x7fe9f0008870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:05:37.577 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.574+0000 7fea03fff640 1 -- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 msgr2=0x7fe9f0008870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:37.577 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.574+0000 7fea03fff640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 0x7fe9f0008870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:37.577 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.574+0000 7fea03fff640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 0x7fe9f0008870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:05:37.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.978+0000 7fea03fff640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 0x7fe9f0008870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:37.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.978+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> v2:10.20.193.119:3300/0 conn(0x7fe9f0003860 msgr2=0x7fe9f0005ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T12:05:37.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.978+0000 7fea03fff640 10 monclient(hunting): get_auth_request con 0x7fe9f00063d0 auth_method 0 2026-02-17T12:05:37.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.978+0000 7fea03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:37.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.978+0000 7fea03fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:37.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.978+0000 7fea03fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:37.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.978+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.119:3300/0 conn(0x7fe9f0003860 0x7fe9f0005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:05:37.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.978+0000 7fea03fff640 1 -- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 msgr2=0x7fe9f0008870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T12:05:37.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.978+0000 7fea03fff640 1 -- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 msgr2=0x7fe9f0008870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:37.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.978+0000 7fea03fff640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 0x7fe9f0008870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:37.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:37.978+0000 7fea03fff640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 0x7fe9f0008870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:05:38.783 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:38.782+0000 7fea03fff640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 0x7fe9f0008870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.783 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:38.782+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> v2:10.20.193.119:3300/0 conn(0x7fe9f0003860 msgr2=0x7fe9f0005ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T12:05:38.783 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:38.782+0000 7fea03fff640 10 monclient(hunting): get_auth_request con 0x7fe9f00063d0 auth_method 0 2026-02-17T12:05:38.783 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:38.782+0000 7fea03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:38.783 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:38.782+0000 7fea03fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:38.784 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:38.782+0000 7fea03fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:38.784 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:38.782+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.119:3300/0 conn(0x7fe9f0003860 0x7fe9f0005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:05:38.784 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:38.782+0000 7fea03fff640 1 -- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 msgr2=0x7fe9f0008870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:05:38.784 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:38.782+0000 7fea03fff640 1 -- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 msgr2=0x7fe9f0008870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:05:38.784 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:38.782+0000 7fea03fff640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 0x7fe9f0008870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:38.784 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:38.782+0000 7fea03fff640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 0x7fe9f0008870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:05:40.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 10 monclient(hunting): tick 2026-02-17T12:05:40.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T12:05:40.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 1 monclient(hunting): continuing hunt 2026-02-17T12:05:40.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T12:05:40.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 1 -- 10.20.193.77:0/323354323 >> v2:10.20.193.119:3300/0 conn(0x7fe9f0003860 msgr2=0x7fe9f0005ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:40.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.119:3300/0 conn(0x7fe9f0003860 0x7fe9f0005ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 1 -- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 msgr2=0x7fe9f0008870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:40.376 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f00063d0 0x7fe9f0008870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea11439640 1 -- 10.20.193.77:0/323354323 reap_dead start 2026-02-17T12:05:40.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 10 monclient: _add_conns ranks=[3,0,1,4,2] 2026-02-17T12:05:40.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f0003cd0 0x7fe9f00067b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 10 monclient(hunting): picked mon.noname-a con 0x7fe9f0003cd0 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:40.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe9f0006cf0 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:40.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe9f00088c0 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:40.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 1 -- 10.20.193.77:0/323354323 --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea0c0a33f0 con 0x7fe9f0006cf0 2026-02-17T12:05:40.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 1 -- 10.20.193.77:0/323354323 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea0c09caa0 con 0x7fe9f00088c0 2026-02-17T12:05:40.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 1 -- 10.20.193.77:0/323354323 --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fea0c09cd80 con 0x7fe9f0003cd0 2026-02-17T12:05:40.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea027fc640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.377 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea11439640 1 -- 10.20.193.77:0/323354323 >> v1:10.20.193.119:6789/0 conn(0x7fe9f00088c0 legacy=0x7fe9f000d3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T12:05:40.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> v2:10.20.193.77:3300/0 conn(0x7fe9f0003cd0 0x7fe9f00067b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 10 monclient(hunting): get_auth_request con 0x7fe9f0003cd0 auth_method 0 2026-02-17T12:05:40.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 10 monclient(hunting): handle_auth_done global_id 4383 payload 274 2026-02-17T12:05:40.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> v1:10.20.193.119:6789/0 conn(0x7fe9f00088c0 legacy=0x7fe9f000d3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:40.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> v1:10.20.193.77:6789/0 conn(0x7fe9f0006cf0 legacy=0x7fe9f0007170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:40.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 1 monclient: found mon.noname-a 2026-02-17T12:05:40.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:40.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.370+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f0010cd0 con 0x7fe9f0003cd0 2026-02-17T12:05:40.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea10c38640 1 -- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe9f0003cd0 msgr2=0x7fe9f00067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe9f0003cd0 0x7fe9f00067b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc009180 tx=0x7fe9fc01d2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5448a4c30950c66b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea10c38640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe9f0003cd0 0x7fe9f00067b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc009180 tx=0x7fe9fc01d2b0 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7fe9fc0b3070 mon_map magic: 0 2026-02-17T12:05:40.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea037fe640 1 -- 10.20.193.77:0/323354323 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc0b3070 con 0x7fe9f0003cd0 2026-02-17T12:05:40.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.386 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea037fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:40.386 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea037fe640 10 monclient: dump: 2026-02-17T12:05:40.386 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.386 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.386 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.386 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.386 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.386 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.386 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.386 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.386 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.386 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.387 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea037fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.387 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea037fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.387 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.387 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea037fe640 1 -- 10.20.193.77:0/323354323 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9fc0ae410 con 0x7fe9f0003cd0 2026-02-17T12:05:40.387 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea037fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:40.387 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea12ec3640 5 monclient: authenticate success, global_id 4383 2026-02-17T12:05:40.387 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea12ec3640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:40.387 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea12ec3640 4 set_mon_vals no callback set 2026-02-17T12:05:40.387 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea12ec3640 10 monclient: shutdown 2026-02-17T12:05:40.387 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea12ec3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:40.387 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea12ec3640 1 -- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe9f0003cd0 msgr2=0x7fe9f00067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.387 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea12ec3640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe9f0003cd0 0x7fe9f00067b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc009180 tx=0x7fe9fc01d2b0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.388 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea037fe640 1 -- 10.20.193.77:0/323354323 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 0 0 0) 0x7fe9fc00f040 con 0x7fe9f0003cd0 2026-02-17T12:05:40.388 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea037fe640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-17T12:05:40.388 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea12ec3640 1 -- 10.20.193.77:0/323354323 shutdown_connections 2026-02-17T12:05:40.388 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea12ec3640 1 --2- 10.20.193.77:0/323354323 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe9f0003cd0 0x7fe9f00067b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.388 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea12ec3640 1 -- 10.20.193.77:0/323354323 >> 10.20.193.77:0/323354323 conn(0x7fea0c0a76d0 msgr2=0x7fea0c0a7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.388 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea12ec3640 1 -- 10.20.193.77:0/323354323 shutdown_connections 2026-02-17T12:05:40.389 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.374+0000 7fea12ec3640 1 -- 10.20.193.77:0/323354323 wait complete. 2026-02-17T12:05:40.389 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient: build_initial_monmap 2026-02-17T12:05:40.389 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient: monmap: 2026-02-17T12:05:40.389 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:40.389 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:40.389 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:40.389 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:40.390 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:40.390 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.390 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:40.390 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:40.390 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:40.390 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.391 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 1 Processor -- start 2026-02-17T12:05:40.391 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 1 -- start start 2026-02-17T12:05:40.391 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient: init 2026-02-17T12:05:40.391 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.391 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:05:40.391 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe9f0003cd0 0x7fea0c132bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.391 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient(hunting): picked mon.noname-a con 0x7fe9f0003cd0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:40.391 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9f0006cf0 0x7fea0c11f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.391 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient(hunting): picked mon.noname-b con 0x7fe9f0006cf0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:40.391 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe9f00088c0 0x7fea0c11f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.391 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient(hunting): picked mon.noname-c con 0x7fe9f00088c0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:40.391 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c133f00 con 0x7fe9f0003cd0 2026-02-17T12:05:40.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c133d80 con 0x7fe9f0006cf0 2026-02-17T12:05:40.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fea0c134080 con 0x7fe9f00088c0 2026-02-17T12:05:40.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient(hunting): authenticate will time out at 592.056943s 2026-02-17T12:05:40.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea03fff640 1 -- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9f0006cf0 msgr2=0x7fea0c11f400 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T12:05:40.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea03fff640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9f0006cf0 0x7fea0c11f400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:40.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea11439640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe9f00088c0 0x7fea0c11f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea11439640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe9f00088c0 0x7fea0c11f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:48566/0 (socket says 10.20.193.77:48566) 2026-02-17T12:05:40.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea11439640 1 -- 10.20.193.77:0/90881248 learned_addr learned my addr 10.20.193.77:0/90881248 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:40.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea11439640 10 monclient(hunting): get_auth_request con 0x7fe9f00088c0 auth_method 0 2026-02-17T12:05:40.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea11439640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea11439640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea11439640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 1 --2- 10.20.193.77:0/90881248 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe9f0003cd0 0x7fea0c132bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 10 monclient(hunting): get_auth_request con 0x7fe9f0003cd0 auth_method 0 2026-02-17T12:05:40.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea11439640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea11439640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea11439640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 10 monclient(hunting): handle_auth_done global_id 4386 payload 824 2026-02-17T12:05:40.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 1 -- 10.20.193.77:0/90881248 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe9f00088c0 msgr2=0x7fea0c11f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 1 --2- 10.20.193.77:0/90881248 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe9f00088c0 0x7fea0c11f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 1 -- 10.20.193.77:0/90881248 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9f0006cf0 msgr2=0x7fea0c11f400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:40.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 1 --2- 10.20.193.77:0/90881248 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9f0006cf0 0x7fea0c11f400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 1 monclient: found mon.noname-a 2026-02-17T12:05:40.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:40.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 1 -- 10.20.193.77:0/90881248 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea0c1c4a90 con 0x7fe9f0003cd0 2026-02-17T12:05:40.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea11439640 1 --2- 10.20.193.77:0/90881248 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe9f00088c0 0x7fea0c11f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:05:40.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 1 -- 10.20.193.77:0/90881248 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe9f0003cd0 msgr2=0x7fea0c132bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea10c38640 1 --2- 10.20.193.77:0/90881248 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe9f0003cd0 0x7fea0c132bd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00036a0 tx=0x7fe9fc01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea017fa640 1 -- 10.20.193.77:0/90881248 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc0b3040 con 0x7fe9f0003cd0 2026-02-17T12:05:40.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea017fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:40.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea017fa640 10 monclient: dump: 2026-02-17T12:05:40.395 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.395 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.395 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.395 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.395 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.396 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.396 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.396 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.396 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.396 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea017fa640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea017fa640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea017fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea017fa640 1 -- 10.20.193.77:0/90881248 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9fc0100b0 con 0x7fe9f0003cd0 2026-02-17T12:05:40.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea017fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:40.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea017fa640 1 -- 10.20.193.77:0/90881248 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc003260 con 0x7fe9f0003cd0 2026-02-17T12:05:40.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea017fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:40.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea017fa640 10 monclient: dump: 2026-02-17T12:05:40.397 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.397 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.397 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.397 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.397 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.397 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.398 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.398 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.398 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.398 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea02ffd640 4 set_mon_vals no callback set 2026-02-17T12:05:40.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 5 monclient: authenticate success, global_id 4386 2026-02-17T12:05:40.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient: _renew_subs 2026-02-17T12:05:40.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:40.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 1 -- 10.20.193.77:0/90881248 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea0c138f30 con 0x7fe9f0003cd0 2026-02-17T12:05:40.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient: _renew_subs 2026-02-17T12:05:40.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:40.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.378+0000 7fea12ec3640 1 -- 10.20.193.77:0/90881248 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea0c13ca40 con 0x7fe9f0003cd0 2026-02-17T12:05:40.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.382+0000 7fea017fa640 1 -- 10.20.193.77:0/90881248 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fe9fc015040 con 0x7fe9f0003cd0 2026-02-17T12:05:40.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.382+0000 7fea12ec3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.382+0000 7fea12ec3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.382+0000 7fea12ec3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:40.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.382+0000 7fea12ec3640 1 -- 10.20.193.77:0/90881248 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea0c1344b0 con 0x7fe9f0003cd0 2026-02-17T12:05:40.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.382+0000 7fea017fa640 1 --2- 10.20.193.77:0/90881248 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe9dc03a0d0 0x7fe9dc03c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.382+0000 7fea017fa640 1 -- 10.20.193.77:0/90881248 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3893+0+0 (secure 0 0 0) 0x7fe9fc0e7f70 con 0x7fe9f0003cd0 2026-02-17T12:05:40.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.382+0000 7fea03fff640 1 --2- 10.20.193.77:0/90881248 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe9dc03a0d0 0x7fe9dc03c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.382+0000 7fea03fff640 10 monclient: get_auth_request con 0x7fe9dc03a0d0 auth_method 0 2026-02-17T12:05:40.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.382+0000 7fea017fa640 1 -- 10.20.193.77:0/90881248 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7fea0c1c4a90 con 0x7fe9f0003cd0 2026-02-17T12:05:40.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.382+0000 7fea017fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.382+0000 7fea017fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:40.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.382+0000 7fea03fff640 1 --2- 10.20.193.77:0/90881248 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe9dc03a0d0 0x7fe9dc03c590 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4002420 tx=0x7fe9f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:05:40.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:40.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:40.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 1 -- 10.20.193.77:0/90881248 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fea0c121540 con 0x7fe9f0003cd0 2026-02-17T12:05:40.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea017fa640 1 -- 10.20.193.77:0/90881248 <== mon.0 v2:10.20.193.77:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1550 (secure 0 0 0) 0x7fe9fc016fc0 con 0x7fe9f0003cd0 2026-02-17T12:05:40.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea017fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:05:40.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea017fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:40.492 INFO:teuthology.orchestra.run.trial077.stdout:{"election_epoch":10,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"093d53f2-7cd0-4506-a27d-4c950e190615","modified":"2026-02-17T12:04:22.035180Z","created":"2026-02-17T12:04:22.035180Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:3300","nonce":0},{"type":"v1","addr":"10.20.193.77:6789","nonce":0}]},"addr":"10.20.193.77:6789/0","public_addr":"10.20.193.77:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:3300","nonce":0},{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:3301","nonce":0},{"type":"v1","addr":"10.20.193.77:6790","nonce":0}]},"addr":"10.20.193.77:6790/0","public_addr":"10.20.193.77:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:05:40.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 1 -- 10.20.193.77:0/90881248 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe9dc03a0d0 msgr2=0x7fe9dc03c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 1 --2- 10.20.193.77:0/90881248 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe9dc03a0d0 0x7fe9dc03c590 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4002420 tx=0x7fe9f4009040 comp rx=0 tx=0).stop 2026-02-17T12:05:40.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 10 monclient: shutdown 2026-02-17T12:05:40.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:40.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 1 -- 10.20.193.77:0/90881248 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe9f0003cd0 msgr2=0x7fea0c132bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 1 --2- 10.20.193.77:0/90881248 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe9f0003cd0 0x7fea0c132bd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00036a0 tx=0x7fe9fc01baf0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 1 -- 10.20.193.77:0/90881248 shutdown_connections 2026-02-17T12:05:40.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 1 --2- 10.20.193.77:0/90881248 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe9dc03a0d0 0x7fe9dc03c590 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 1 --2- 10.20.193.77:0/90881248 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe9f00088c0 0x7fea0c11f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 1 --2- 10.20.193.77:0/90881248 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe9f0006cf0 0x7fea0c11f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 1 --2- 10.20.193.77:0/90881248 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe9f0003cd0 0x7fea0c132bd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.486+0000 7fea12ec3640 1 -- 10.20.193.77:0/90881248 >> 10.20.193.77:0/90881248 conn(0x7fea0c0a76d0 msgr2=0x7fea0c0a06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.490+0000 7fea12ec3640 1 -- 10.20.193.77:0/90881248 shutdown_connections 2026-02-17T12:05:40.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.490+0000 7fea12ec3640 1 -- 10.20.193.77:0/90881248 wait complete. 2026-02-17T12:05:40.502 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-17T12:05:40.502 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-17T12:05:40.503 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:05:40.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 10 monclient: get_monmap_and_config 2026-02-17T12:05:40.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 10 monclient: build_initial_monmap 2026-02-17T12:05:40.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 10 monclient: monmap: 2026-02-17T12:05:40.566 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:40.566 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.566 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:40.565477+0000 2026-02-17T12:05:40.567 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:40.565477+0000 2026-02-17T12:05:40.567 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:40.567 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.567 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:40.567 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:40.567 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:40.567 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:40.567 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:40.567 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.567 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 1 Processor -- start 2026-02-17T12:05:40.567 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 1 -- start start 2026-02-17T12:05:40.567 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 10 monclient: init 2026-02-17T12:05:40.568 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.568 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2026-02-17T12:05:40.568 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbaa00a07d0 0x7fbaa00a2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.568 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 10 monclient(hunting): picked mon.noname-b con 0x7fbaa00a07d0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:40.568 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fbaa00a2750 0x7fbaa00a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.568 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 10 monclient(hunting): picked mon.noname-c con 0x7fbaa00a2750 addr v2:10.20.193.119:3300/0 2026-02-17T12:05:40.568 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fbaa013a990 0x7fbaa013cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.568 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 10 monclient(hunting): picked mon.noname-a con 0x7fbaa013a990 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:40.568 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.568 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa009ed40 con 0x7fbaa013a990 2026-02-17T12:05:40.568 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.569 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa00a3070 con 0x7fbaa00a2750 2026-02-17T12:05:40.569 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.569 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa009d4a0 con 0x7fbaa00a07d0 2026-02-17T12:05:40.569 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.569 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fbaa4aa4640 10 monclient(hunting): authenticate will time out at 592.240865s 2026-02-17T12:05:40.569 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9dd74640 1 -- >> v2:10.20.193.119:3300/0 conn(0x7fbaa00a2750 msgr2=0x7fbaa00a2b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T12:05:40.569 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9dd74640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fbaa00a2750 0x7fbaa00a2b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:40.569 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fbaa013a990 0x7fbaa013cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.569 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9e575640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbaa00a07d0 0x7fbaa00a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.569 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fbaa013a990 0x7fbaa013cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:50818/0 (socket says 10.20.193.77:50818) 2026-02-17T12:05:40.569 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 1 -- 10.20.193.77:0/2226133197 learned_addr learned my addr 10.20.193.77:0/2226133197 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:40.569 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 10 monclient(hunting): get_auth_request con 0x7fbaa013a990 auth_method 0 2026-02-17T12:05:40.569 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.570 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.570 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.570 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9e575640 10 monclient(hunting): get_auth_request con 0x7fbaa00a07d0 auth_method 0 2026-02-17T12:05:40.570 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.570 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.570 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.570 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.570 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.570 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.570 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.570 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.570 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.570 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 10 monclient(hunting): handle_auth_done global_id 4389 payload 274 2026-02-17T12:05:40.571 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 1 -- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbaa00a07d0 msgr2=0x7fbaa00a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:40.571 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbaa00a07d0 0x7fbaa00a2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.571 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 1 -- 10.20.193.77:0/2226133197 >> v2:10.20.193.119:3300/0 conn(0x7fbaa00a2750 msgr2=0x7fbaa00a2b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:40.571 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 1 --2- 10.20.193.77:0/2226133197 >> v2:10.20.193.119:3300/0 conn(0x7fbaa00a2750 0x7fbaa00a2b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.571 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.571 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 1 monclient: found mon.noname-a 2026-02-17T12:05:40.571 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.571 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:40.571 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.562+0000 7fba9ed76640 1 -- 10.20.193.77:0/2226133197 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa009ea60 con 0x7fbaa013a990 2026-02-17T12:05:40.583 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9ed76640 1 -- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 msgr2=0x7fbaa013cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.583 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9ed76640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 0x7fbaa013cd80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbaa009d180 tx=0x7fba9001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a5613fd693f189 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.583 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9ed76640 1 -- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 msgr2=0x7fbaa013cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-17T12:05:40.583 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9ed76640 1 -- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 msgr2=0x7fbaa013cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:05:40.583 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9ed76640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 0x7fbaa013cd80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbaa009d180 tx=0x7fba9001c8f0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:40.583 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9ed76640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 0x7fbaa013cd80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbaa009d180 tx=0x7fba9001c8f0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.583 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient: ms_handle_reset current mon [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:40.583 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.583 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 msgr2=0x7fbaa013cd80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:40.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 0x7fbaa013cd80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient: _add_conns ranks=[0,1] 2026-02-17T12:05:40.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fba8c003610 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:40.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fba8c0075a0 addr v1:10.20.193.119:6789/0 2026-02-17T12:05:40.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba8c00b510 con 0x7fba8c003610 2026-02-17T12:05:40.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba8c00c710 con 0x7fba8c0075a0 2026-02-17T12:05:40.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient(hunting): ms_handle_reset stray mon [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:40.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9dd74640 1 -- 10.20.193.77:0/2226133197 >> v1:10.20.193.119:6789/0 conn(0x7fba8c0075a0 legacy=0x7fba8c009a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-17T12:05:40.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9e575640 1 -- 10.20.193.77:0/2226133197 >> v1:10.20.193.77:6789/0 conn(0x7fba8c003610 legacy=0x7fba8c005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 <== mon.0 v1:10.20.193.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4133312429 0 0) 0x7fba8c00b510 con 0x7fba8c003610 2026-02-17T12:05:40.584 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient(hunting): _negotiate 2026-02-17T12:05:40.585 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.585 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:40.585 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 --> v1:10.20.193.77:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fba8c00b6e0 con 0x7fba8c003610 2026-02-17T12:05:40.585 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 <== mon.0 v1:10.20.193.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 2014454297 0 0) 0x7fba8c00b6e0 con 0x7fba8c003610 2026-02-17T12:05:40.585 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 >> v1:10.20.193.119:6789/0 conn(0x7fba8c0075a0 legacy=0x7fba8c009a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:40.585 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.585 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 monclient: found mon.noname-a-legacy 2026-02-17T12:05:40.585 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.585 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.77:6789/0 2026-02-17T12:05:40.585 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 --> v1:10.20.193.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8c00d9d0 con 0x7fba8c003610 2026-02-17T12:05:40.585 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.585 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.586 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.586 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 <== mon.0 v1:10.20.193.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3360639233 0 0) 0x7fba94009b60 con 0x7fba8c003610 2026-02-17T12:05:40.586 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.586 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T12:05:40.586 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient: dump: 2026-02-17T12:05:40.586 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.586 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.586 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.586 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.586 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.586 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.586 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.586 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.587 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.587 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] but i'm connected to v1:10.20.193.77:6789/0, reconnecting 2026-02-17T12:05:40.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 >> v1:10.20.193.77:6789/0 conn(0x7fba8c003610 legacy=0x7fba8c005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:05:40.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9ed76640 1 -- 10.20.193.77:0/2226133197 reap_dead start 2026-02-17T12:05:40.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fba8c00be40 0x7fba8c00c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 10 monclient(hunting): picked mon.a con 0x7fba8c00be40 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:40.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.566+0000 7fba9d573640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba8c00ce20 0x7fba8c00d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 10 monclient(hunting): picked mon.b con 0x7fba8c00ce20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:40.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fba8c0099e0 0x7fba8c00a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 10 monclient(hunting): picked mon.c con 0x7fba8c0099e0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:40.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c009f30 con 0x7fba8c00be40 2026-02-17T12:05:40.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c00a770 con 0x7fba8c00ce20 2026-02-17T12:05:40.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fba8c00a970 con 0x7fba8c0099e0 2026-02-17T12:05:40.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 10 monclient(hunting): _finish_auth 0 2026-02-17T12:05:40.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fba8c00be40 0x7fba8c00c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 10 monclient(hunting): get_auth_request con 0x7fba8c00be40 auth_method 0 2026-02-17T12:05:40.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9dd74640 1 -- 10.20.193.77:0/2226133197 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba8c00ce20 msgr2=0x7fba8c00d280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T12:05:40.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:40.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9dd74640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba8c00ce20 0x7fba8c00d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:40.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:05:40.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9ed76640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fba8c0099e0 0x7fba8c00a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9ed76640 10 monclient(hunting): get_auth_request con 0x7fba8c0099e0 auth_method 0 2026-02-17T12:05:40.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.589 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9ed76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:05:40.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 10 monclient(hunting): handle_auth_done global_id 4389 payload 293 2026-02-17T12:05:40.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 1 -- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fba8c0099e0 msgr2=0x7fba8c00a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:40.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fba8c0099e0 0x7fba8c00a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 1 -- 10.20.193.77:0/2226133197 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba8c00ce20 msgr2=0x7fba8c00d280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:05:40.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba8c00ce20 0x7fba8c00d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 1 monclient: found mon.a 2026-02-17T12:05:40.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:40.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 1 -- 10.20.193.77:0/2226133197 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8c00b6e0 con 0x7fba8c00be40 2026-02-17T12:05:40.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.590 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.591 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 5 monclient: authenticate success, global_id 4389 2026-02-17T12:05:40.591 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:40.591 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 1 -- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fba8c00be40 msgr2=0x7fba8c00c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.591 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9e575640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fba8c00be40 0x7fba8c00c8e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fba940094b0 tx=0x7fba8c00b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbeee6c0d343a18 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.591 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94017070 con 0x7fba8c00be40 2026-02-17T12:05:40.591 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.591 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:40.591 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 10 monclient: dump: 2026-02-17T12:05:40.591 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.591 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.591 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.591 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.591 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.592 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.592 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.592 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.592 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.592 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.592 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba94013470 con 0x7fba8c00be40 2026-02-17T12:05:40.592 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:40.592 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:40.592 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 1 -- 10.20.193.77:0/2226133197 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9400c3c0 con 0x7fba8c00be40 2026-02-17T12:05:40.592 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 4 set_mon_vals no callback set 2026-02-17T12:05:40.592 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.592 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:40.593 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fba9d573640 10 monclient: dump: 2026-02-17T12:05:40.593 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.593 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.593 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.593 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.593 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.593 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.593 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.593 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.593 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.593 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.593 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 10 monclient: shutdown 2026-02-17T12:05:40.593 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:40.594 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fba8c00be40 msgr2=0x7fba8c00c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.594 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fba8c00be40 0x7fba8c00c8e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fba940094b0 tx=0x7fba8c00b920 comp rx=0 tx=0).stop 2026-02-17T12:05:40.594 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/2226133197 shutdown_connections 2026-02-17T12:05:40.594 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fba8c0099e0 0x7fba8c00a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.594 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba8c00ce20 0x7fba8c00d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.594 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fba8c00be40 0x7fba8c00c8e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.594 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 1 --2- 10.20.193.77:0/2226133197 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 0x7fbaa013cd80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.594 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/2226133197 >> 10.20.193.77:0/2226133197 conn(0x7fbaa00a73c0 msgr2=0x7fbaa00a3300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.594 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/2226133197 shutdown_connections 2026-02-17T12:05:40.594 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/2226133197 wait complete. 2026-02-17T12:05:40.594 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 10 monclient: build_initial_monmap 2026-02-17T12:05:40.594 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 10 monclient: monmap: 2026-02-17T12:05:40.595 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:40.595 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:40.595 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:40.595 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:40.595 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:40.595 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.595 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:40.595 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:40.595 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:40.595 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.595 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 1 Processor -- start 2026-02-17T12:05:40.595 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 1 -- start start 2026-02-17T12:05:40.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.570+0000 7fbaa4aa4640 10 monclient: init 2026-02-17T12:05:40.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:05:40.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fba8c0099e0 0x7fbaa013a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient(hunting): picked mon.noname-c con 0x7fba8c0099e0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:40.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fba8c00be40 0x7fbaa0090810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient(hunting): picked mon.noname-a con 0x7fba8c00be40 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:40.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba8c00ce20 0x7fbaa0090d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient(hunting): picked mon.noname-b con 0x7fba8c00ce20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:40.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa00a0d30 con 0x7fba8c00be40 2026-02-17T12:05:40.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.596 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa00a0bb0 con 0x7fba8c00ce20 2026-02-17T12:05:40.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa009f720 con 0x7fba8c0099e0 2026-02-17T12:05:40.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient(hunting): authenticate will time out at 592.252350s 2026-02-17T12:05:40.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fba8c0099e0 0x7fbaa013a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fba8c00be40 0x7fbaa0090810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9ed76640 1 -- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba8c00ce20 msgr2=0x7fbaa0090d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T12:05:40.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fba8c00be40 0x7fbaa0090810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:50836/0 (socket says 10.20.193.77:50836) 2026-02-17T12:05:40.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9ed76640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba8c00ce20 0x7fbaa0090d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:40.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fba8c0099e0 0x7fbaa013a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:48600/0 (socket says 10.20.193.77:48600) 2026-02-17T12:05:40.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 1 -- 10.20.193.77:0/26180312 learned_addr learned my addr 10.20.193.77:0/26180312 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:40.597 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 10 monclient(hunting): get_auth_request con 0x7fba8c00be40 auth_method 0 2026-02-17T12:05:40.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient(hunting): get_auth_request con 0x7fba8c0099e0 auth_method 0 2026-02-17T12:05:40.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.598 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 10 monclient(hunting): handle_auth_done global_id 4392 payload 824 2026-02-17T12:05:40.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 1 -- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fba8c0099e0 msgr2=0x7fbaa013a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 1 --2- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fba8c0099e0 0x7fbaa013a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 1 -- 10.20.193.77:0/26180312 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba8c00ce20 msgr2=0x7fbaa0090d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:40.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 1 --2- 10.20.193.77:0/26180312 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fba8c00ce20 0x7fbaa0090d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 1 monclient: found mon.noname-a 2026-02-17T12:05:40.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:40.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 1 -- 10.20.193.77:0/26180312 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa00940e0 con 0x7fba8c00be40 2026-02-17T12:05:40.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 1 -- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fba8c00be40 msgr2=0x7fbaa0090810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9dd74640 1 --2- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fba8c00be40 0x7fbaa0090810 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fba8800ba10 tx=0x7fba8800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba86ffd640 1 -- 10.20.193.77:0/26180312 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8800c940 con 0x7fba8c00be40 2026-02-17T12:05:40.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.599 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba86ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:40.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba86ffd640 10 monclient: dump: 2026-02-17T12:05:40.600 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.600 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.600 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.600 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.600 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.600 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.600 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.600 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.600 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.600 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba86ffd640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba86ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.600 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba86ffd640 1 -- 10.20.193.77:0/26180312 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba88010070 con 0x7fba8c00be40 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba86ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba86ffd640 1 -- 10.20.193.77:0/26180312 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8800cd20 con 0x7fba8c00be40 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba86ffd640 10 monclient: dump: 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.601 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9cd72640 4 set_mon_vals no callback set 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 5 monclient: authenticate success, global_id 4392 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient: _renew_subs 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/26180312 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa0092850 con 0x7fba8c00be40 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient: _renew_subs 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/26180312 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa0093e00 con 0x7fba8c00be40 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 1 --2- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 0x7fbaa0091290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/26180312 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa013b000 con 0x7fbaa013a990 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 1 --2- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 0x7fbaa0091290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient: get_auth_request con 0x7fbaa013a990 auth_method 0 2026-02-17T12:05:40.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 10 monclient(hunting): handle_auth_done global_id 4395 payload 824 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba9e575640 1 -- 10.20.193.77:0/26180312 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbaa0092f70 con 0x7fbaa013a990 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.574+0000 7fba86ffd640 1 -- 10.20.193.77:0/26180312 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fba8801d030 con 0x7fba8c00be40 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba86ffd640 1 --2- 10.20.193.77:0/26180312 >> v2:10.20.193.119:6800/4127986552 conn(0x7fba6c03a120 0x7fba6c03c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba86ffd640 1 -- 10.20.193.77:0/26180312 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3893+0+0 (secure 0 0 0) 0x7fba8804d540 con 0x7fba8c00be40 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba9ed76640 1 --2- 10.20.193.77:0/26180312 >> v2:10.20.193.119:6800/4127986552 conn(0x7fba6c03a120 0x7fba6c03c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba9ed76640 10 monclient: get_auth_request con 0x7fba6c03a120 auth_method 0 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba9e575640 1 -- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 msgr2=0x7fbaa0091290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba9e575640 1 --2- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 0x7fbaa0091290 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba940094b0 tx=0x7fba940047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba86ffd640 1 -- 10.20.193.77:0/26180312 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9402d070 con 0x7fbaa013a990 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba86ffd640 10 monclient: dump: 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba86ffd640 1 -- 10.20.193.77:0/26180312 <== mon.0 v2:10.20.193.77:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fba94013a90 con 0x7fbaa013a990 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba86ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba86ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:40.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba86ffd640 1 -- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 msgr2=0x7fbaa0091290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba86ffd640 1 --2- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 0x7fbaa0091290 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba940094b0 tx=0x7fba940047d0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba86ffd640 1 -- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 msgr2=0x7fbaa0091290 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:40.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba86ffd640 1 --2- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa013a990 0x7fbaa0091290 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba940094b0 tx=0x7fba940047d0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.578+0000 7fba9ed76640 1 --2- 10.20.193.77:0/26180312 >> v2:10.20.193.119:6800/4127986552 conn(0x7fba6c03a120 0x7fba6c03c5e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0072d0 tx=0x7fba900a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fbaa4aa4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fbaa4aa4640 1 --2- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa0073fc0 0x7fbaa00638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fbaa4aa4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/26180312 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa00a1d70 con 0x7fbaa0073fc0 2026-02-17T12:05:40.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fba9e575640 1 --2- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa0073fc0 0x7fbaa00638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fba9e575640 10 monclient: get_auth_request con 0x7fbaa0073fc0 auth_method 0 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fba9e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fba9e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fba9e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fba9e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fba9e575640 10 monclient(hunting): handle_auth_done global_id 4398 payload 824 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fba9e575640 1 -- 10.20.193.77:0/26180312 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbaa006d670 con 0x7fbaa0073fc0 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fba9e575640 1 -- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa0073fc0 msgr2=0x7fbaa00638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.582+0000 7fba9e575640 1 --2- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa0073fc0 0x7fbaa00638d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0077360 tx=0x7fba94004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fba86ffd640 1 -- 10.20.193.77:0/26180312 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9402d050 con 0x7fbaa0073fc0 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fba86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fba86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fba86ffd640 10 monclient: dump: 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.607 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fba86ffd640 1 -- 10.20.193.77:0/26180312 <== mon.0 v2:10.20.193.77:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4865 (secure 0 0 0) 0x7fba9402e040 con 0x7fbaa0073fc0 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fba86ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fba86ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fba86ffd640 1 -- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa0073fc0 msgr2=0x7fbaa00638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fba86ffd640 1 --2- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa0073fc0 0x7fbaa00638d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0077360 tx=0x7fba94004840 comp rx=0 tx=0).stop 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fba86ffd640 1 -- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa0073fc0 msgr2=0x7fbaa00638d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:40.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fba86ffd640 1 --2- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbaa0073fc0 0x7fbaa00638d0 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0077360 tx=0x7fba94004840 comp rx=0 tx=0).stop 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: "name": "a", 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 0, 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: "state": "leader", 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: "election_epoch": 10, 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: "uptime": 52562, 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: "quorum": [ 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: 0, 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: 2 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_age": 1, 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: "required_mon": [ 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:40.609 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_mon": [ 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:40.610 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "outside_quorum": [], 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "extra_probe_peers": [], 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "sync_provider": [], 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "monmap": { 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "epoch": 1, 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "fsid": "093d53f2-7cd0-4506-a27d-4c950e190615", 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "modified": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "created": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release": 19, 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "election_strategy": 1, 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "disallowed_leaders": "", 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false, 2026-02-17T12:05:40.611 INFO:teuthology.orchestra.run.trial077.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "removed_ranks": "", 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "persistent": [ 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "optional": [] 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "mons": [ 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 0, 2026-02-17T12:05:40.612 INFO:teuthology.orchestra.run.trial077.stdout: "name": "a", 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3300", 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789", 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789/0", 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6789/0", 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:40.613 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 1, 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: "name": "b", 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:3300", 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789", 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789/0", 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:40.614 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 2, 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: "name": "c", 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3301", 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790", 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.615 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790/0", 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6790/0", 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: "feature_map": { 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: "mon": [ 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: "osd": [ 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: "num": 5 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.616 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: "client": [ 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: "num": 4 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: "mgr": [ 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false 2026-02-17T12:05:40.617 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T12:05:40.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/26180312 >> v2:10.20.193.119:6800/4127986552 conn(0x7fba6c03a120 msgr2=0x7fba6c03c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fbaa4aa4640 1 --2- 10.20.193.77:0/26180312 >> v2:10.20.193.119:6800/4127986552 conn(0x7fba6c03a120 0x7fba6c03c5e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0072d0 tx=0x7fba900a7070 comp rx=0 tx=0).stop 2026-02-17T12:05:40.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fbaa4aa4640 10 monclient: shutdown 2026-02-17T12:05:40.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fbaa4aa4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:40.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fba8c00be40 msgr2=0x7fbaa0090810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fbaa4aa4640 1 --2- 10.20.193.77:0/26180312 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fba8c00be40 0x7fbaa0090810 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fba8800ba10 tx=0x7fba8800bed0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fba9ed76640 1 -- 10.20.193.77:0/26180312 reap_dead start 2026-02-17T12:05:40.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fba9ed76640 1 -- 10.20.193.77:0/26180312 reap_dead start 2026-02-17T12:05:40.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/26180312 shutdown_connections 2026-02-17T12:05:40.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/26180312 >> 10.20.193.77:0/26180312 conn(0x7fbaa00a73c0 msgr2=0x7fbaa0071720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/26180312 shutdown_connections 2026-02-17T12:05:40.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.586+0000 7fbaa4aa4640 1 -- 10.20.193.77:0/26180312 wait complete. 2026-02-17T12:05:40.619 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:05:40.619 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-17T12:05:40.619 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 10 monclient: get_monmap_and_config 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 10 monclient: build_initial_monmap 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 10 monclient: monmap: 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:05:40.683758+0000 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:05:40.683758+0000 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:05:40.682 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 1 Processor -- start 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 1 -- start start 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 10 monclient: init 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 10 monclient: _add_conns ranks=[3,0,2,4,1] 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7efca0068460 0x7efca00a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 10 monclient(hunting): picked mon.noname-a con 0x7efca0068460 addr v2:10.20.193.77:3300/0 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7efca00a0850 addr v1:10.20.193.77:6789/0 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca013b8d0 0x7efca013dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 10 monclient(hunting): picked mon.noname-b con 0x7efca013b8d0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca009bf50 con 0x7efca00a0850 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7efca0068840 con 0x7efca0068460 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7efca009c230 con 0x7efca013b8d0 2026-02-17T12:05:40.685 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efca534f640 10 monclient(hunting): authenticate will time out at 592.359272s 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7efca0068460 0x7efca00a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9e7fc640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7efca00a0850 0x7efca00a3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:38574/0 (socket says 10.20.193.77:38574) 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9e7fc640 1 -- 10.20.193.77:0/3485228306 learned_addr learned my addr 10.20.193.77:0/3485228306 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7efca0068460 0x7efca00a2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:50870/0 (socket says 10.20.193.77:50870) 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 10 monclient(hunting): get_auth_request con 0x7efca0068460 auth_method 0 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9f7fe640 1 --2- 10.20.193.77:0/3485228306 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca013b8d0 0x7efca013dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9f7fe640 10 monclient(hunting): get_auth_request con 0x7efca013b8d0 auth_method 0 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.686 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 10 monclient(hunting): handle_auth_done global_id 4401 payload 274 2026-02-17T12:05:40.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 1 -- 10.20.193.77:0/3485228306 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca013b8d0 msgr2=0x7efca013dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:40.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 1 --2- 10.20.193.77:0/3485228306 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca013b8d0 0x7efca013dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 1 -- 10.20.193.77:0/3485228306 >> v1:10.20.193.77:6789/0 conn(0x7efca00a0850 legacy=0x7efca00a3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:05:40.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 1 monclient: found mon.noname-a 2026-02-17T12:05:40.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:05:40.687 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.678+0000 7efc9effd640 1 -- 10.20.193.77:0/3485228306 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca00a49c0 con 0x7efca0068460 2026-02-17T12:05:40.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9effd640 1 -- 10.20.193.77:0/3485228306 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7efca0068460 msgr2=0x7efca00a2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9effd640 1 --2- 10.20.193.77:0/3485228306 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7efca0068460 0x7efca00a2ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efc940098c0 tx=0x7efc9401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f176309147444b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9dffb640 1 -- 10.20.193.77:0/3485228306 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc940b0070 con 0x7efca0068460 2026-02-17T12:05:40.689 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9dffb640 10 monclient: dump: 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9dffb640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9dffb640 1 -- 10.20.193.77:0/3485228306 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc940ab600 con 0x7efca0068460 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 5 monclient: authenticate success, global_id 4401 2026-02-17T12:05:40.690 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9dffb640 1 -- 10.20.193.77:0/3485228306 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc940ab9d0 con 0x7efca0068460 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 10 monclient: get_monmap_and_config success 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 4 set_mon_vals no callback set 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efc9dffb640 10 monclient: dump: 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 10 monclient: shutdown 2026-02-17T12:05:40.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 1 -- 10.20.193.77:0/3485228306 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7efca0068460 msgr2=0x7efca00a2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 1 --2- 10.20.193.77:0/3485228306 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7efca0068460 0x7efca00a2ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efc940098c0 tx=0x7efc9401c480 comp rx=0 tx=0).stop 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 1 -- 10.20.193.77:0/3485228306 shutdown_connections 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 1 --2- 10.20.193.77:0/3485228306 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca013b8d0 0x7efca013dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 1 --2- 10.20.193.77:0/3485228306 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7efca0068460 0x7efca00a2ad0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 1 -- 10.20.193.77:0/3485228306 >> 10.20.193.77:0/3485228306 conn(0x7efca006cee0 msgr2=0x7efca00a3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 1 -- 10.20.193.77:0/3485228306 shutdown_connections 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 1 -- 10.20.193.77:0/3485228306 wait complete. 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 10 monclient: build_initial_monmap 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 10 monclient: monmap: 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:05:40.692 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 1 Processor -- start 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 1 -- start start 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.682+0000 7efca534f640 10 monclient: init 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient: _reopen_session rank -1 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0068460 0x7efca01d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient(hunting): picked mon.noname-c con 0x7efca0068460 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7efca00a0850 0x7efca01d3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient(hunting): picked mon.noname-a con 0x7efca00a0850 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efca013b8d0 0x7efca0123dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient(hunting): picked mon.noname-b con 0x7efca013b8d0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7efca00a38a0 con 0x7efca00a0850 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7efca00a3720 con 0x7efca013b8d0 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7efca0140a20 con 0x7efca0068460 2026-02-17T12:05:40.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient(hunting): _renew_subs 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient(hunting): authenticate will time out at 592.364125s 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0068460 0x7efca01d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0068460 0x7efca01d2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:48604/0 (socket says 10.20.193.77:48604) 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 1 -- 10.20.193.77:0/3365470269 learned_addr learned my addr 10.20.193.77:0/3365470269 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 10 monclient(hunting): get_auth_request con 0x7efca0068460 auth_method 0 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7efca00a0850 0x7efca01d3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9f7fe640 1 -- 10.20.193.77:0/3365470269 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efca013b8d0 msgr2=0x7efca0123dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.119:3300/0 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 10 monclient(hunting): get_auth_request con 0x7efca00a0850 auth_method 0 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9f7fe640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efca013b8d0 0x7efca0123dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:40.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 10 monclient(hunting): handle_auth_done global_id 4382 payload 824 2026-02-17T12:05:40.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 1 -- 10.20.193.77:0/3365470269 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efca013b8d0 msgr2=0x7efca0123dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:40.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7efca013b8d0 0x7efca0123dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 1 -- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7efca00a0850 msgr2=0x7efca01d3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7efca00a0850 0x7efca01d3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 10 monclient: _finish_hunting 0 2026-02-17T12:05:40.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 1 monclient: found mon.noname-c 2026-02-17T12:05:40.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:05:40.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:05:40.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 1 -- 10.20.193.77:0/3365470269 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca0126350 con 0x7efca0068460 2026-02-17T12:05:40.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7efca00a0850 0x7efca01d3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 1 -- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0068460 msgr2=0x7efca01d2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9effd640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0068460 0x7efca01d2cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc940098c0 tx=0x7efc94019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 1 -- 10.20.193.77:0/3365470269 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc940b0040 con 0x7efca0068460 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 10 monclient: dump: 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.698 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 1 -- 10.20.193.77:0/3365470269 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc940b9070 con 0x7efca0068460 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 5 monclient: authenticate success, global_id 4382 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient: _renew_subs 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 1 -- 10.20.193.77:0/3365470269 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca0127d60 con 0x7efca0068460 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 1 -- 10.20.193.77:0/3365470269 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc940aaa10 con 0x7efca0068460 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 10 monclient: dump: 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.699 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9d7fa640 4 set_mon_vals no callback set 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient: _renew_subs 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 1 -- 10.20.193.77:0/3365470269 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efca013de60 con 0x7efca0068460 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca01276c0 0x7efca0124310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efca534f640 1 -- 10.20.193.77:0/3365470269 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7efca006ef90 con 0x7efca01276c0 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca01276c0 0x7efca0124310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 10 monclient: get_auth_request con 0x7efca01276c0 auth_method 0 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 1 -- 10.20.193.77:0/3365470269 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7efc940b3070 con 0x7efca0068460 2026-02-17T12:05:40.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 10 monclient(hunting): handle_auth_done global_id 4385 payload 824 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9e7fc640 1 -- 10.20.193.77:0/3365470269 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efca00a2ad0 con 0x7efca01276c0 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 1 --2- 10.20.193.77:0/3365470269 >> v2:10.20.193.119:6800/4127986552 conn(0x7efc6c03a0d0 0x7efc6c03c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc7f7fe640 1 -- 10.20.193.77:0/3365470269 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 3893+0+0 (secure 0 0 0) 0x7efc940e7620 con 0x7efca0068460 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9f7fe640 1 --2- 10.20.193.77:0/3365470269 >> v2:10.20.193.119:6800/4127986552 conn(0x7efc6c03a0d0 0x7efc6c03c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.686+0000 7efc9f7fe640 10 monclient: get_auth_request con 0x7efc6c03a0d0 auth_method 0 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.690+0000 7efc9e7fc640 1 -- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca01276c0 msgr2=0x7efca0124310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.690+0000 7efc9e7fc640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca01276c0 0x7efca0124310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efca0125670 tx=0x7efc8800eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.690+0000 7efc7f7fe640 1 -- 10.20.193.77:0/3365470269 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc88005bf0 con 0x7efca01276c0 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.690+0000 7efc7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.690+0000 7efc7f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.690+0000 7efc7f7fe640 10 monclient: dump: 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.701 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.690+0000 7efc7f7fe640 1 -- 10.20.193.77:0/3365470269 <== mon.2 v2:10.20.193.77:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7efc88018070 con 0x7efca01276c0 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.690+0000 7efc7f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.690+0000 7efc7f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.690+0000 7efc7f7fe640 1 -- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca01276c0 msgr2=0x7efca0124310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.690+0000 7efc7f7fe640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca01276c0 0x7efca0124310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efca0125670 tx=0x7efc8800eb90 comp rx=0 tx=0).stop 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.690+0000 7efc7f7fe640 1 -- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca01276c0 msgr2=0x7efca0124310 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.690+0000 7efc7f7fe640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca01276c0 0x7efca0124310 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efca0125670 tx=0x7efc8800eb90 comp rx=0 tx=0).stop 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.690+0000 7efc9f7fe640 1 --2- 10.20.193.77:0/3365470269 >> v2:10.20.193.119:6800/4127986552 conn(0x7efc6c03a0d0 0x7efc6c03c590 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efc90009bb0 tx=0x7efc9000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.694+0000 7efca534f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.694+0000 7efca534f640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0124850 0x7efca01ddd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.694+0000 7efca534f640 10 monclient(hunting): start opening mon connection 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.694+0000 7efca534f640 1 -- 10.20.193.77:0/3365470269 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7efca013b670 con 0x7efca0124850 2026-02-17T12:05:40.702 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.694+0000 7efc9e7fc640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0124850 0x7efca01ddd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.703 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.694+0000 7efc9e7fc640 1 -- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0124850 msgr2=0x7efca01ddd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:05:40.703 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.694+0000 7efc9e7fc640 1 -- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0124850 msgr2=0x7efca01ddd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:05:40.703 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.694+0000 7efc9e7fc640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0124850 0x7efca01ddd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:05:40.703 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.694+0000 7efc9e7fc640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0124850 0x7efca01ddd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:40.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc9e7fc640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0124850 0x7efca01ddd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc9e7fc640 10 monclient: get_auth_request con 0x7efca0124850 auth_method 0 2026-02-17T12:05:40.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc9e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:05:40.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:05:40.900 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:05:40.901 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc9e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:05:40.901 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc9e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:05:40.901 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc9e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:05:40.901 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc9e7fc640 10 monclient(hunting): handle_auth_done global_id 4388 payload 824 2026-02-17T12:05:40.901 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc9e7fc640 1 -- 10.20.193.77:0/3365470269 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efca006dd00 con 0x7efca0124850 2026-02-17T12:05:40.902 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc9e7fc640 1 -- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0124850 msgr2=0x7efca01ddd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:05:40.902 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc9e7fc640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0124850 0x7efca01ddd40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc88017000 tx=0x7efc88004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.903 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc7f7fe640 1 -- 10.20.193.77:0/3365470269 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8801d240 con 0x7efca0124850 2026-02-17T12:05:40.903 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:05:40.903 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc7f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:05:40.903 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc7f7fe640 10 monclient: dump: 2026-02-17T12:05:40.903 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:05:40.903 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:05:40.903 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.903 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:05:40.903 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:05:40.903 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:05:40.903 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:05:40.903 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:05:40.904 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:05:40.904 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:05:40.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc7f7fe640 1 -- 10.20.193.77:0/3365470269 <== mon.2 v2:10.20.193.77:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4696 (secure 0 0 0) 0x7efc8801d240 con 0x7efca0124850 2026-02-17T12:05:40.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc7f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:05:40.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc7f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:05:40.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc7f7fe640 1 -- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0124850 msgr2=0x7efca01ddd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc7f7fe640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0124850 0x7efca01ddd40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc88017000 tx=0x7efc88004a50 comp rx=0 tx=0).stop 2026-02-17T12:05:40.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc7f7fe640 1 -- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0124850 msgr2=0x7efca01ddd40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:05:40.904 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc7f7fe640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0124850 0x7efca01ddd40 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc88017000 tx=0x7efc88004a50 comp rx=0 tx=0).stop 2026-02-17T12:05:40.905 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T12:05:40.905 INFO:teuthology.orchestra.run.trial077.stdout: "name": "c", 2026-02-17T12:05:40.905 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 2, 2026-02-17T12:05:40.905 INFO:teuthology.orchestra.run.trial077.stdout: "state": "peon", 2026-02-17T12:05:40.905 INFO:teuthology.orchestra.run.trial077.stdout: "election_epoch": 10, 2026-02-17T12:05:40.905 INFO:teuthology.orchestra.run.trial077.stdout: "uptime": 52862, 2026-02-17T12:05:40.905 INFO:teuthology.orchestra.run.trial077.stdout: "quorum": [ 2026-02-17T12:05:40.905 INFO:teuthology.orchestra.run.trial077.stdout: 0, 2026-02-17T12:05:40.905 INFO:teuthology.orchestra.run.trial077.stdout: 2 2026-02-17T12:05:40.906 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:40.906 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_age": 1, 2026-02-17T12:05:40.906 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:05:40.906 INFO:teuthology.orchestra.run.trial077.stdout: "required_con": "2450521708007866372", 2026-02-17T12:05:40.906 INFO:teuthology.orchestra.run.trial077.stdout: "required_mon": [ 2026-02-17T12:05:40.906 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:40.906 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:40.906 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:40.906 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:40.906 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:40.906 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:40.906 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:40.907 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:40.907 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:40.907 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:40.907 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:40.907 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:40.907 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:05:40.907 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_mon": [ 2026-02-17T12:05:40.907 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:40.907 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:40.907 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:40.907 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:40.907 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial077.stdout: "outside_quorum": [], 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial077.stdout: "extra_probe_peers": [], 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial077.stdout: "sync_provider": [], 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial077.stdout: "monmap": { 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial077.stdout: "epoch": 1, 2026-02-17T12:05:40.908 INFO:teuthology.orchestra.run.trial077.stdout: "fsid": "093d53f2-7cd0-4506-a27d-4c950e190615", 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial077.stdout: "modified": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial077.stdout: "created": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release": 19, 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release_name": "squid", 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial077.stdout: "election_strategy": 1, 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial077.stdout: "disallowed_leaders": "", 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false, 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial077.stdout: "tiebreaker_mon": "", 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial077.stdout: "removed_ranks": "", 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial077.stdout: "persistent": [ 2026-02-17T12:05:40.909 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial077.stdout: "optional": [] 2026-02-17T12:05:40.910 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial077.stdout: "mons": [ 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 0, 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial077.stdout: "name": "a", 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3300", 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.911 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789", 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789/0", 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6789/0", 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 1, 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: "name": "b", 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:40.912 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:3300", 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789", 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789/0", 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-17T12:05:40.913 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 2, 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: "name": "c", 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3301", 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.914 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790", 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790/0", 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6790/0", 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: "feature_map": { 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: "mon": [ 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.915 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: "osd": [ 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: "client": [ 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: "num": 6 2026-02-17T12:05:40.916 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:05:40.917 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:05:40.917 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:05:40.917 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false 2026-02-17T12:05:40.917 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efca534f640 1 -- 10.20.193.77:0/3365470269 >> v2:10.20.193.119:6800/4127986552 conn(0x7efc6c03a0d0 msgr2=0x7efc6c03c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efca534f640 1 --2- 10.20.193.77:0/3365470269 >> v2:10.20.193.119:6800/4127986552 conn(0x7efc6c03a0d0 0x7efc6c03c590 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efc90009bb0 tx=0x7efc9000b040 comp rx=0 tx=0).stop 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efca534f640 10 monclient: shutdown 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efca534f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efca534f640 1 -- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0068460 msgr2=0x7efca01d2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efca534f640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0068460 0x7efca01d2cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc940098c0 tx=0x7efc94019220 comp rx=0 tx=0).stop 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efc9f7fe640 1 -- 10.20.193.77:0/3365470269 reap_dead start 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efca534f640 1 -- 10.20.193.77:0/3365470269 shutdown_connections 2026-02-17T12:05:40.918 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efca534f640 1 --2- 10.20.193.77:0/3365470269 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7efca0068460 0x7efca01d2cc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efca534f640 1 -- 10.20.193.77:0/3365470269 >> 10.20.193.77:0/3365470269 conn(0x7efca006cee0 msgr2=0x7efca00a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efca534f640 1 -- 10.20.193.77:0/3365470269 shutdown_connections 2026-02-17T12:05:40.919 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:05:40.898+0000 7efca534f640 1 -- 10.20.193.77:0/3365470269 wait complete. 2026-02-17T12:05:40.919 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-17T12:05:40.919 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-17T12:05:41.399 INFO:teuthology.orchestra.run.trial119.stdout:process_1_[18345]: starting. 2026-02-17T12:05:41.399 INFO:teuthology.orchestra.run.trial119.stdout:process_1_[18345]: creating pool ceph_test_rados_delete_pools_parallel.trial119-18344 2026-02-17T12:05:41.399 INFO:teuthology.orchestra.run.trial119.stdout:process_1_[18345]: created object 0... 2026-02-17T12:05:41.399 INFO:teuthology.orchestra.run.trial119.stdout:process_1_[18345]: created object 25... 2026-02-17T12:05:41.399 INFO:teuthology.orchestra.run.trial119.stdout:process_1_[18345]: created object 49... 2026-02-17T12:05:41.399 INFO:teuthology.orchestra.run.trial119.stdout:process_1_[18345]: finishing. 2026-02-17T12:05:41.399 INFO:teuthology.orchestra.run.trial119.stdout:process_1_[18345]: shutting down. 2026-02-17T12:05:42.321 INFO:teuthology.orchestra.run.trial119.stdout:process_2_[18346]: starting. 2026-02-17T12:05:42.322 INFO:teuthology.orchestra.run.trial119.stdout:process_2_[18346]: deleting pool ceph_test_rados_delete_pools_parallel.trial119-18344 2026-02-17T12:05:42.322 INFO:teuthology.orchestra.run.trial119.stdout:process_2_[18346]: shutting down. 2026-02-17T12:05:44.427 INFO:teuthology.orchestra.run.trial119.stdout:******************************* 2026-02-17T12:05:44.428 INFO:teuthology.orchestra.run.trial119.stdout:process_3_[18380]: starting. 2026-02-17T12:05:44.428 INFO:teuthology.orchestra.run.trial119.stdout:process_3_[18380]: creating pool ceph_test_rados_delete_pools_parallel.trial119-18344 2026-02-17T12:05:44.428 INFO:teuthology.orchestra.run.trial119.stdout:process_3_[18380]: created object 0... 2026-02-17T12:05:44.428 INFO:teuthology.orchestra.run.trial119.stdout:process_3_[18380]: created object 25... 2026-02-17T12:05:44.428 INFO:teuthology.orchestra.run.trial119.stdout:process_3_[18380]: created object 49... 2026-02-17T12:05:44.428 INFO:teuthology.orchestra.run.trial119.stdout:process_3_[18380]: finishing. 2026-02-17T12:05:44.428 INFO:teuthology.orchestra.run.trial119.stdout:process_3_[18380]: shutting down. 2026-02-17T12:05:44.464 INFO:teuthology.orchestra.run.trial119.stdout:******************************* 2026-02-17T12:05:44.464 INFO:teuthology.orchestra.run.trial119.stdout:process_5_[18382]: starting. 2026-02-17T12:05:44.464 INFO:teuthology.orchestra.run.trial119.stdout:process_5_[18382]: listing objects. 2026-02-17T12:05:44.464 INFO:teuthology.orchestra.run.trial119.stdout:process_5_[18382]: listed object 0... 2026-02-17T12:05:44.464 INFO:teuthology.orchestra.run.trial119.stdout:process_5_[18382]: listed object 25... 2026-02-17T12:05:44.465 INFO:teuthology.orchestra.run.trial119.stdout:process_5_[18382]: saw 50 objects 2026-02-17T12:05:44.465 INFO:teuthology.orchestra.run.trial119.stdout:process_5_[18382]: shutting down. 2026-02-17T12:05:45.331 INFO:teuthology.orchestra.run.trial119.stdout:******************************* 2026-02-17T12:05:45.331 INFO:teuthology.orchestra.run.trial119.stdout:process_4_[18381]: starting. 2026-02-17T12:05:45.331 INFO:teuthology.orchestra.run.trial119.stdout:process_4_[18381]: deleting pool ceph_test_rados_delete_pools_parallel.trial119-18344 2026-02-17T12:05:45.331 INFO:teuthology.orchestra.run.trial119.stdout:process_4_[18381]: shutting down. 2026-02-17T12:05:45.333 INFO:teuthology.orchestra.run.trial119.stdout:******************************* 2026-02-17T12:05:45.333 INFO:teuthology.orchestra.run.trial119.stdout:******************************* 2026-02-17T12:05:45.333 INFO:teuthology.orchestra.run.trial119.stdout:******* SUCCESS ********** 2026-02-17T12:05:45.335 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2026-02-17T12:05:45.352 INFO:tasks.mon_thrash:joining mon_thrasher 2026-02-17T12:07:10.920 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-17T12:07:10.920 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-17T12:07:10.920 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T12:07:10.921 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T12:07:10.931 INFO:tasks.ceph.mon.b:Started 2026-02-17T12:07:10.932 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-17T12:07:10.932 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-17T12:07:10.932 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-17T12:07:25.933 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-17T12:07:25.933 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-17T12:07:25.933 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:07:25.934 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:07:25.995 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 10 monclient: get_monmap_and_config 2026-02-17T12:07:25.996 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 10 monclient: build_initial_monmap 2026-02-17T12:07:25.996 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 10 monclient: monmap: 2026-02-17T12:07:25.996 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:25.996 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:25.996 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:25.992426+0000 2026-02-17T12:07:25.996 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:25.992426+0000 2026-02-17T12:07:25.996 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:25.996 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:25.996 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:25.997 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:25.997 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:25.997 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:25.997 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:25.997 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:25.997 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 1 Processor -- start 2026-02-17T12:07:25.997 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 1 -- start start 2026-02-17T12:07:25.997 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 10 monclient: init 2026-02-17T12:07:25.997 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:25.997 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 10 monclient: _add_conns ranks=[1,2,4,3,0] 2026-02-17T12:07:25.997 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f553c0a3120 addr v1:10.20.193.119:6789/0 2026-02-17T12:07:25.997 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f553c06f7c0 0x7f553c13d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:25.998 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 10 monclient(hunting): picked mon.noname-b con 0x7f553c06f7c0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:25.998 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f553c0a3c10 0x7f553c13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:25.998 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 10 monclient(hunting): picked mon.noname-c con 0x7f553c0a3c10 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:25.998 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f553c0a4b50 con 0x7f553c0a3120 2026-02-17T12:07:25.998 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:25.998 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f553c06f350 con 0x7f553c0a3c10 2026-02-17T12:07:25.998 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:25.998 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f553c06ea20 con 0x7f553c06f7c0 2026-02-17T12:07:25.998 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:25.998 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f55419e0640 10 monclient(hunting): authenticate will time out at 697.667852s 2026-02-17T12:07:25.998 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.987+0000 7f553a7fc640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f553c06f7c0 0x7f553c13d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:25.998 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f553c06f7c0 0x7f553c13d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:56112/0 (socket says 10.20.193.77:56112) 2026-02-17T12:07:25.999 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 1 -- 10.20.193.77:0/2066566300 learned_addr learned my addr 10.20.193.77:0/2066566300 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:25.999 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 10 monclient(hunting): get_auth_request con 0x7f553c06f7c0 auth_method 0 2026-02-17T12:07:25.999 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:25.999 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:25.999 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:25.999 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553b7fe640 1 --2- 10.20.193.77:0/2066566300 >> v2:10.20.193.119:3300/0 conn(0x7f553c0a3c10 0x7f553c13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:25.999 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:25.999 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:25.999 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:25.999 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553b7fe640 10 monclient(hunting): get_auth_request con 0x7f553c0a3c10 auth_method 0 2026-02-17T12:07:25.999 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:25.999 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.000 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.000 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 10 monclient(hunting): handle_auth_done global_id 4400 payload 274 2026-02-17T12:07:26.000 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 1 -- 10.20.193.77:0/2066566300 >> v2:10.20.193.119:3300/0 conn(0x7f553c0a3c10 msgr2=0x7f553c13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:26.000 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 1 --2- 10.20.193.77:0/2066566300 >> v2:10.20.193.119:3300/0 conn(0x7f553c0a3c10 0x7f553c13fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.000 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 1 -- 10.20.193.77:0/2066566300 >> v1:10.20.193.119:6789/0 conn(0x7f553c0a3120 legacy=0x7f553c0a3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:26.000 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 10 monclient: _finish_hunting 0 2026-02-17T12:07:26.000 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 1 monclient: found mon.noname-b 2026-02-17T12:07:26.000 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:26.000 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:07:26.000 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 1 -- 10.20.193.77:0/2066566300 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c06ed00 con 0x7f553c06f7c0 2026-02-17T12:07:26.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 1 -- 10.20.193.77:0/2066566300 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f553c06f7c0 msgr2=0x7f553c13d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f553a7fc640 1 --2- 10.20.193.77:0/2066566300 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f553c06f7c0 0x7f553c13d920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5524009970 tx=0x7f552401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b8d3a67fbb6da72 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f5539ffb640 1 -- 10.20.193.77:0/2066566300 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55240b0070 con 0x7f553c06f7c0 2026-02-17T12:07:26.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f5539ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f5539ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:26.007 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f5539ffb640 10 monclient: dump: 2026-02-17T12:07:26.007 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.007 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.007 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.007 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.007 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.007 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.007 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.007 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.007 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.007 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.007 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f5539ffb640 10 monclient: _finish_auth 0 2026-02-17T12:07:26.008 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f5539ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:07:26.008 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f5539ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:26.008 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f5539ffb640 1 -- 10.20.193.77:0/2066566300 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5524004230 con 0x7f553c06f7c0 2026-02-17T12:07:26.008 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f5539ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:26.008 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f55419e0640 5 monclient: authenticate success, global_id 4400 2026-02-17T12:07:26.008 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f5539ffb640 1 -- 10.20.193.77:0/2066566300 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524003720 con 0x7f553c06f7c0 2026-02-17T12:07:26.008 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f55419e0640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:26.008 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f5539ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.009 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f55419e0640 4 set_mon_vals no callback set 2026-02-17T12:07:26.009 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f5539ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:26.009 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.991+0000 7f5539ffb640 10 monclient: dump: 2026-02-17T12:07:26.009 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.009 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.009 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.009 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.010 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.010 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.010 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.010 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.010 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.010 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.010 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 10 monclient: shutdown 2026-02-17T12:07:26.010 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:26.010 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 -- 10.20.193.77:0/2066566300 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f553c06f7c0 msgr2=0x7f553c13d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.010 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 --2- 10.20.193.77:0/2066566300 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f553c06f7c0 0x7f553c13d920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5524009970 tx=0x7f552401c540 comp rx=0 tx=0).stop 2026-02-17T12:07:26.011 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 -- 10.20.193.77:0/2066566300 shutdown_connections 2026-02-17T12:07:26.011 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 --2- 10.20.193.77:0/2066566300 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f553c06f7c0 0x7f553c13d920 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.011 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 --2- 10.20.193.77:0/2066566300 >> v2:10.20.193.119:3300/0 conn(0x7f553c0a3c10 0x7f553c13fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.011 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 -- 10.20.193.77:0/2066566300 >> 10.20.193.77:0/2066566300 conn(0x7f553c0a8820 msgr2=0x7f553c0a8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:26.011 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 -- 10.20.193.77:0/2066566300 shutdown_connections 2026-02-17T12:07:26.011 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 -- 10.20.193.77:0/2066566300 wait complete. 2026-02-17T12:07:26.011 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 10 monclient: build_initial_monmap 2026-02-17T12:07:26.012 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 10 monclient: monmap: 2026-02-17T12:07:26.012 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:26.012 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:26.012 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:26.012 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:26.012 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:26.012 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.012 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:26.012 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:26.012 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:26.013 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.013 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 Processor -- start 2026-02-17T12:07:26.013 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 -- start start 2026-02-17T12:07:26.013 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 10 monclient: init 2026-02-17T12:07:26.013 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:26.013 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:07:26.013 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f553c06f7c0 0x7f553c13ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.013 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 10 monclient(hunting): picked mon.noname-a con 0x7f553c06f7c0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:26.013 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f553c0a3120 0x7f553c13f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.013 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 10 monclient(hunting): picked mon.noname-b con 0x7f553c0a3120 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:26.013 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f553c0a3c10 0x7f553c1d1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.013 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 10 monclient(hunting): picked mon.noname-c con 0x7f553c0a3c10 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:26.014 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.014 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f553c142d50 con 0x7f553c06f7c0 2026-02-17T12:07:26.014 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.014 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f553c142bd0 con 0x7f553c0a3120 2026-02-17T12:07:26.014 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.014 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f553c142ed0 con 0x7f553c0a3c10 2026-02-17T12:07:26.014 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:26.014 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f55419e0640 10 monclient(hunting): authenticate will time out at 697.673478s 2026-02-17T12:07:26.014 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f553c06f7c0 0x7f553c13ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.014 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553b7fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f553c0a3c10 0x7f553c1d1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.014 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f553c06f7c0 0x7f553c13ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:54924/0 (socket says 10.20.193.77:54924) 2026-02-17T12:07:26.014 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 1 -- 10.20.193.77:0/1464759371 learned_addr learned my addr 10.20.193.77:0/1464759371 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:26.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 10 monclient(hunting): get_auth_request con 0x7f553c06f7c0 auth_method 0 2026-02-17T12:07:26.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553b7fe640 10 monclient(hunting): get_auth_request con 0x7f553c0a3c10 auth_method 0 2026-02-17T12:07:26.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553a7fc640 1 --2- 10.20.193.77:0/1464759371 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f553c0a3120 0x7f553c13f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.015 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553a7fc640 10 monclient(hunting): get_auth_request con 0x7f553c0a3120 auth_method 0 2026-02-17T12:07:26.016 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.016 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.016 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.016 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.016 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.016 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.016 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 10 monclient(hunting): handle_auth_done global_id 4425 payload 824 2026-02-17T12:07:26.016 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 1 -- 10.20.193.77:0/1464759371 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f553c0a3c10 msgr2=0x7f553c1d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.016 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 1 --2- 10.20.193.77:0/1464759371 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f553c0a3c10 0x7f553c1d1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.016 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 1 -- 10.20.193.77:0/1464759371 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f553c0a3120 msgr2=0x7f553c13f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.016 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 1 --2- 10.20.193.77:0/1464759371 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f553c0a3120 0x7f553c13f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.016 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:26.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 1 monclient: found mon.noname-a 2026-02-17T12:07:26.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:26.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:26.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 1 -- 10.20.193.77:0/1464759371 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c09f1e0 con 0x7f553c06f7c0 2026-02-17T12:07:26.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553a7fc640 1 --2- 10.20.193.77:0/1464759371 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f553c0a3120 0x7f553c13f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:07:26.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 1 -- 10.20.193.77:0/1464759371 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f553c06f7c0 msgr2=0x7f553c13ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.995+0000 7f553affd640 1 --2- 10.20.193.77:0/1464759371 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f553c06f7c0 0x7f553c13ebd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f553000c550 tx=0x7f553000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 1 -- 10.20.193.77:0/1464759371 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530016020 con 0x7f553c06f7c0 2026-02-17T12:07:26.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:26.017 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 10 monclient: dump: 2026-02-17T12:07:26.017 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.018 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.018 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.018 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.018 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.018 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.018 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.018 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.018 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.018 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.018 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 10 monclient: _finish_auth 0 2026-02-17T12:07:26.018 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 10 monclient: _check_auth_tickets 2026-02-17T12:07:26.018 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:26.018 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 1 -- 10.20.193.77:0/1464759371 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5530012a60 con 0x7f553c06f7c0 2026-02-17T12:07:26.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:26.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 1 -- 10.20.193.77:0/1464759371 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530012e50 con 0x7f553c06f7c0 2026-02-17T12:07:26.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:26.019 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 10 monclient: dump: 2026-02-17T12:07:26.019 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.019 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.019 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.019 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.019 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.019 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.019 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.020 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.020 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.020 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.020 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f55397fa640 4 set_mon_vals no callback set 2026-02-17T12:07:26.020 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f55419e0640 5 monclient: authenticate success, global_id 4425 2026-02-17T12:07:26.020 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f55419e0640 10 monclient: _renew_subs 2026-02-17T12:07:26.020 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f55419e0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:26.020 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f55419e0640 1 -- 10.20.193.77:0/1464759371 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553c13c690 con 0x7f553c06f7c0 2026-02-17T12:07:26.020 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f55419e0640 10 monclient: _renew_subs 2026-02-17T12:07:26.020 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f55419e0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:26.020 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f55419e0640 1 -- 10.20.193.77:0/1464759371 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553c09fa10 con 0x7f553c06f7c0 2026-02-17T12:07:26.020 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f55419e0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:26.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f55419e0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:26.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f55419e0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:26.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f55419e0640 1 -- 10.20.193.77:0/1464759371 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f553c0a3500 con 0x7f553c06f7c0 2026-02-17T12:07:26.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 1 -- 10.20.193.77:0/1464759371 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f553001b400 con 0x7f553c06f7c0 2026-02-17T12:07:26.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 1 --2- 10.20.193.77:0/1464759371 >> v2:10.20.193.119:6800/4127986552 conn(0x7f550c03a2c0 0x7f550c03c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f5513fff640 1 -- 10.20.193.77:0/1464759371 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f553004dcf0 con 0x7f553c06f7c0 2026-02-17T12:07:26.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f553a7fc640 1 --2- 10.20.193.77:0/1464759371 >> v2:10.20.193.119:6800/4127986552 conn(0x7f550c03a2c0 0x7f550c03c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f553a7fc640 10 monclient: get_auth_request con 0x7f550c03a2c0 auth_method 0 2026-02-17T12:07:26.021 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:25.999+0000 7f553a7fc640 1 --2- 10.20.193.77:0/1464759371 >> v2:10.20.193.119:6800/4127986552 conn(0x7f550c03a2c0 0x7f550c03c780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f553c0a6350 tx=0x7f55240a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.003+0000 7f5513fff640 1 -- 10.20.193.77:0/1464759371 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f5530020020 con 0x7f553c06f7c0 2026-02-17T12:07:26.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.003+0000 7f5513fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:26.022 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.003+0000 7f5513fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:26.109 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:07:26.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:07:26.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:26.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 1 -- 10.20.193.77:0/1464759371 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f553c069210 con 0x7f553c06f7c0 2026-02-17T12:07:26.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f5513fff640 1 -- 10.20.193.77:0/1464759371 <== mon.0 v2:10.20.193.77:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f553001bbf0 con 0x7f553c06f7c0 2026-02-17T12:07:26.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f5513fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:07:26.110 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f5513fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:26.110 INFO:teuthology.orchestra.run.trial077.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"093d53f2-7cd0-4506-a27d-4c950e190615","modified":"2026-02-17T12:04:22.035180Z","created":"2026-02-17T12:04:22.035180Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:3300","nonce":0},{"type":"v1","addr":"10.20.193.77:6789","nonce":0}]},"addr":"10.20.193.77:6789/0","public_addr":"10.20.193.77:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:3300","nonce":0},{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:3301","nonce":0},{"type":"v1","addr":"10.20.193.77:6790","nonce":0}]},"addr":"10.20.193.77:6790/0","public_addr":"10.20.193.77:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:07:26.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 1 -- 10.20.193.77:0/1464759371 >> v2:10.20.193.119:6800/4127986552 conn(0x7f550c03a2c0 msgr2=0x7f550c03c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.111 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 1 --2- 10.20.193.77:0/1464759371 >> v2:10.20.193.119:6800/4127986552 conn(0x7f550c03a2c0 0x7f550c03c780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f553c0a6350 tx=0x7f55240a6000 comp rx=0 tx=0).stop 2026-02-17T12:07:26.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 10 monclient: shutdown 2026-02-17T12:07:26.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:26.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 1 -- 10.20.193.77:0/1464759371 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f553c06f7c0 msgr2=0x7f553c13ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 1 --2- 10.20.193.77:0/1464759371 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f553c06f7c0 0x7f553c13ebd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f553000c550 tx=0x7f553000ca10 comp rx=0 tx=0).stop 2026-02-17T12:07:26.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 1 -- 10.20.193.77:0/1464759371 shutdown_connections 2026-02-17T12:07:26.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 1 --2- 10.20.193.77:0/1464759371 >> v2:10.20.193.119:6800/4127986552 conn(0x7f550c03a2c0 0x7f550c03c780 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 1 --2- 10.20.193.77:0/1464759371 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f553c0a3c10 0x7f553c1d1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 1 --2- 10.20.193.77:0/1464759371 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f553c0a3120 0x7f553c13f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 1 --2- 10.20.193.77:0/1464759371 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f553c06f7c0 0x7f553c13ebd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.112 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 1 -- 10.20.193.77:0/1464759371 >> 10.20.193.77:0/1464759371 conn(0x7f553c0a8820 msgr2=0x7f553c0737d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:26.113 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 1 -- 10.20.193.77:0/1464759371 shutdown_connections 2026-02-17T12:07:26.113 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.103+0000 7f55419e0640 1 -- 10.20.193.77:0/1464759371 wait complete. 2026-02-17T12:07:26.120 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:07:26.120 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-17T12:07:26.120 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-17T12:07:26.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.183+0000 7fd3b5741640 10 monclient: get_monmap_and_config 2026-02-17T12:07:26.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.183+0000 7fd3b5741640 10 monclient: build_initial_monmap 2026-02-17T12:07:26.190 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.183+0000 7fd3b5741640 10 monclient: monmap: 2026-02-17T12:07:26.190 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:26.190 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.190 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:26.189026+0000 2026-02-17T12:07:26.190 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:26.189026+0000 2026-02-17T12:07:26.190 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:26.190 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.191 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:26.191 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:26.191 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:26.191 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:26.191 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:26.191 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 1 Processor -- start 2026-02-17T12:07:26.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 1 -- start start 2026-02-17T12:07:26.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 10 monclient: init 2026-02-17T12:07:26.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:26.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 10 monclient: _add_conns ranks=[4,1,3,0,2] 2026-02-17T12:07:26.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fd3b00a07d0 0x7fd3b00a2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.192 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 10 monclient(hunting): picked mon.noname-c con 0x7fd3b00a07d0 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd3b00a2750 addr v1:10.20.193.119:6789/0 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fd3b00a2b60 0x7fd3b013e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 10 monclient(hunting): picked mon.noname-a con 0x7fd3b00a2b60 addr v2:10.20.193.77:3300/0 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3b009d4a0 con 0x7fd3b00a2750 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd3b009ed40 con 0x7fd3b00a2b60 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd3b009ea60 con 0x7fd3b00a07d0 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3b5741640 10 monclient(hunting): authenticate will time out at 697.864522s 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fd3b00a2b60 0x7fd3b013e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fd3b00a2b60 0x7fd3b013e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:54940/0 (socket says 10.20.193.77:54940) 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 1 -- 10.20.193.77:0/3692652206 learned_addr learned my addr 10.20.193.77:0/3692652206 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 10 monclient(hunting): get_auth_request con 0x7fd3b00a2b60 auth_method 0 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3aeffd640 1 --2- 10.20.193.77:0/3692652206 >> v2:10.20.193.119:3300/0 conn(0x7fd3b00a07d0 0x7fd3b00a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3aeffd640 10 monclient(hunting): get_auth_request con 0x7fd3b00a07d0 auth_method 0 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3aeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.193 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3aeffd640 1 -- 10.20.193.77:0/3692652206 >> v2:10.20.193.119:3300/0 conn(0x7fd3b00a07d0 msgr2=0x7fd3b00a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3aeffd640 1 -- 10.20.193.77:0/3692652206 >> v2:10.20.193.119:3300/0 conn(0x7fd3b00a07d0 msgr2=0x7fd3b00a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3aeffd640 1 --2- 10.20.193.77:0/3692652206 >> v2:10.20.193.119:3300/0 conn(0x7fd3b00a07d0 0x7fd3b00a2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3aeffd640 1 --2- 10.20.193.77:0/3692652206 >> v2:10.20.193.119:3300/0 conn(0x7fd3b00a07d0 0x7fd3b00a2210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 10 monclient(hunting): handle_auth_done global_id 4428 payload 274 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 1 -- 10.20.193.77:0/3692652206 >> v2:10.20.193.119:3300/0 conn(0x7fd3b00a07d0 msgr2=0x7fd3b00a2210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 1 --2- 10.20.193.77:0/3692652206 >> v2:10.20.193.119:3300/0 conn(0x7fd3b00a07d0 0x7fd3b00a2210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 1 -- 10.20.193.77:0/3692652206 >> v1:10.20.193.119:6789/0 conn(0x7fd3b00a2750 legacy=0x7fd3b013a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 1 monclient: found mon.noname-a 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:26.194 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.187+0000 7fd3af7fe640 1 -- 10.20.193.77:0/3692652206 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b00a2fd0 con 0x7fd3b00a2b60 2026-02-17T12:07:26.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 1 -- 10.20.193.77:0/3692652206 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b00a2b60 msgr2=0x7fd3b013e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.195 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 1 --2- 10.20.193.77:0/3692652206 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b00a2b60 0x7fd3b013e0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd3b006ebf0 tx=0x7fd3a001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165ef6a88fabdece server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3adffb640 1 -- 10.20.193.77:0/3692652206 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00a5660 con 0x7fd3b00a2b60 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3adffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3adffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3adffb640 10 monclient: dump: 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3adffb640 10 monclient: _finish_auth 0 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3adffb640 10 monclient: _check_auth_tickets 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3adffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3adffb640 1 -- 10.20.193.77:0/3692652206 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a00a5800 con 0x7fd3b00a2b60 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 5 monclient: authenticate success, global_id 4428 2026-02-17T12:07:26.196 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3adffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3adffb640 1 -- 10.20.193.77:0/3692652206 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00a5bd0 con 0x7fd3b00a2b60 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 4 set_mon_vals no callback set 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3adffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3adffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3adffb640 10 monclient: dump: 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient: shutdown 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 -- 10.20.193.77:0/3692652206 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b00a2b60 msgr2=0x7fd3b013e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 --2- 10.20.193.77:0/3692652206 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b00a2b60 0x7fd3b013e0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd3b006ebf0 tx=0x7fd3a001c8d0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 -- 10.20.193.77:0/3692652206 shutdown_connections 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 --2- 10.20.193.77:0/3692652206 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b00a2b60 0x7fd3b013e0c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.197 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 --2- 10.20.193.77:0/3692652206 >> v2:10.20.193.119:3300/0 conn(0x7fd3b00a07d0 0x7fd3b00a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 -- 10.20.193.77:0/3692652206 >> 10.20.193.77:0/3692652206 conn(0x7fd3b00a73c0 msgr2=0x7fd3b00a3300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:26.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 -- 10.20.193.77:0/3692652206 shutdown_connections 2026-02-17T12:07:26.198 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 -- 10.20.193.77:0/3692652206 wait complete. 2026-02-17T12:07:26.200 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient: build_initial_monmap 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient: monmap: 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 Processor -- start 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 -- start start 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient: init 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd3b00a07d0 0x7fd3b013def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient(hunting): picked mon.noname-b con 0x7fd3b00a07d0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd3b00a2750 0x7fd3b009a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient(hunting): picked mon.noname-c con 0x7fd3b00a2750 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b00a2b60 0x7fd3b009ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient(hunting): picked mon.noname-a con 0x7fd3b00a2b60 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b00a0d30 con 0x7fd3b00a2b60 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b00a0bb0 con 0x7fd3b00a07d0 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b009f720 con 0x7fd3b00a2750 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3b5741640 10 monclient(hunting): authenticate will time out at 697.870583s 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b00a2b60 0x7fd3b009ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b00a2b60 0x7fd3b009ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:54950/0 (socket says 10.20.193.77:54950) 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 1 -- 10.20.193.77:0/1196517048 learned_addr learned my addr 10.20.193.77:0/1196517048 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 10 monclient(hunting): get_auth_request con 0x7fd3b00a2b60 auth_method 0 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3ae7fc640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd3b00a2750 0x7fd3b009a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3ae7fc640 10 monclient(hunting): get_auth_request con 0x7fd3b00a2750 auth_method 0 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3ae7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.202 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3ae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3ae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3ae7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3ae7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3ae7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3aeffd640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd3b00a07d0 0x7fd3b013def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 10 monclient(hunting): handle_auth_done global_id 4431 payload 824 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 1 -- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd3b00a2750 msgr2=0x7fd3b009a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fd3b00a2750 0x7fd3b009a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 1 -- 10.20.193.77:0/1196517048 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd3b00a07d0 msgr2=0x7fd3b013def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd3b00a07d0 0x7fd3b013def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 1 monclient: found mon.noname-a 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3af7fe640 1 -- 10.20.193.77:0/1196517048 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b0098da0 con 0x7fd3b00a2b60 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3aeffd640 10 monclient: get_auth_request con 0x7fd3b00a07d0 auth_method 0 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.191+0000 7fd3aeffd640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fd3b00a07d0 0x7fd3b013def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3af7fe640 1 -- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b00a2b60 msgr2=0x7fd3b009ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3af7fe640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b00a2b60 0x7fd3b009ad70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00af040 tx=0x7fd3a0019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 1 -- 10.20.193.77:0/1196517048 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00bc020 con 0x7fd3b00a2b60 2026-02-17T12:07:26.203 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 10 monclient: dump: 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 1 -- 10.20.193.77:0/1196517048 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a00b8880 con 0x7fd3b00a2b60 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 1 -- 10.20.193.77:0/1196517048 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00b8c70 con 0x7fd3b00a2b60 2026-02-17T12:07:26.204 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3b5741640 5 monclient: authenticate success, global_id 4431 2026-02-17T12:07:26.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3b5741640 10 monclient: _renew_subs 2026-02-17T12:07:26.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3b5741640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:26.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3b5741640 1 -- 10.20.193.77:0/1196517048 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b0097bd0 con 0x7fd3b00a2b60 2026-02-17T12:07:26.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3ad7fa640 4 set_mon_vals no callback set 2026-02-17T12:07:26.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:26.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 10 monclient: dump: 2026-02-17T12:07:26.205 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.205 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.206 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.206 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.206 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.206 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.206 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.206 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.206 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.206 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3b5741640 10 monclient: _renew_subs 2026-02-17T12:07:26.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3b5741640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:26.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3b5741640 1 -- 10.20.193.77:0/1196517048 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b006fae0 con 0x7fd3b00a2b60 2026-02-17T12:07:26.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3b5741640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:26.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3b5741640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b009b2b0 0x7fd3b008f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3b5741640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3b5741640 1 -- 10.20.193.77:0/1196517048 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b009a260 con 0x7fd3b009b2b0 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3aeffd640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b009b2b0 0x7fd3b008f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3aeffd640 10 monclient: get_auth_request con 0x7fd3b009b2b0 auth_method 0 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3aeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3aeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3aeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3aeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 1 -- 10.20.193.77:0/1196517048 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fd3a00b6440 con 0x7fd3b00a2b60 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3aeffd640 10 monclient(hunting): handle_auth_done global_id 4434 payload 824 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3aeffd640 1 -- 10.20.193.77:0/1196517048 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3b009b690 con 0x7fd3b009b2b0 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 1 --2- 10.20.193.77:0/1196517048 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd37c03a170 0x7fd37c03c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd38f7fe640 1 -- 10.20.193.77:0/1196517048 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7fd3a00e8bd0 con 0x7fd3b00a2b60 2026-02-17T12:07:26.207 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3ae7fc640 1 --2- 10.20.193.77:0/1196517048 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd37c03a170 0x7fd37c03c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.208 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.195+0000 7fd3ae7fc640 10 monclient: get_auth_request con 0x7fd37c03a170 auth_method 0 2026-02-17T12:07:26.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3aeffd640 1 -- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b009b2b0 msgr2=0x7fd3b008f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3aeffd640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b009b2b0 0x7fd3b008f3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400e810 tx=0x7fd3a400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd38f7fe640 1 -- 10.20.193.77:0/1196517048 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4019020 con 0x7fd3b009b2b0 2026-02-17T12:07:26.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd38f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd38f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:26.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd38f7fe640 10 monclient: dump: 2026-02-17T12:07:26.211 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.211 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.211 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.211 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.211 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.211 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.211 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.211 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.211 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.211 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd38f7fe640 1 -- 10.20.193.77:0/1196517048 <== mon.0 v2:10.20.193.77:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7fd3a400cb60 con 0x7fd3b009b2b0 2026-02-17T12:07:26.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd38f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:26.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd38f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:26.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd38f7fe640 1 -- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b009b2b0 msgr2=0x7fd3b008f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd38f7fe640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b009b2b0 0x7fd3b008f3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400e810 tx=0x7fd3a400ecd0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd38f7fe640 1 -- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b009b2b0 msgr2=0x7fd3b008f3c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:26.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd38f7fe640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b009b2b0 0x7fd3b008f3c0 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400e810 tx=0x7fd3a400ecd0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3ae7fc640 1 --2- 10.20.193.77:0/1196517048 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd37c03a170 0x7fd37c03c630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3b009c040 tx=0x7fd398007f40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3b5741640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:07:26.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3b5741640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b008f900 0x7fd3b008fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3b5741640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3b5741640 1 -- 10.20.193.77:0/1196517048 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b009c440 con 0x7fd3b008f900 2026-02-17T12:07:26.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3aeffd640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b008f900 0x7fd3b008fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3aeffd640 10 monclient: get_auth_request con 0x7fd3b008f900 auth_method 0 2026-02-17T12:07:26.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3aeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3aeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3aeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3aeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3aeffd640 10 monclient(hunting): handle_auth_done global_id 4437 payload 824 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.199+0000 7fd3aeffd640 1 -- 10.20.193.77:0/1196517048 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd3b00992c0 con 0x7fd3b008f900 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd3aeffd640 1 -- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b008f900 msgr2=0x7fd3b008fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd3aeffd640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b008f900 0x7fd3b008fd10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400e810 tx=0x7fd3a4004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd38f7fe640 1 -- 10.20.193.77:0/1196517048 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4019070 con 0x7fd3b008f900 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd38f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd38f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd38f7fe640 10 monclient: dump: 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.213 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.214 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.214 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.214 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.214 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.214 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.214 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.214 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd38f7fe640 1 -- 10.20.193.77:0/1196517048 <== mon.0 v2:10.20.193.77:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4877 (secure 0 0 0) 0x7fd3a4003230 con 0x7fd3b008f900 2026-02-17T12:07:26.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd38f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:07:26.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd38f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:26.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd38f7fe640 1 -- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b008f900 msgr2=0x7fd3b008fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd38f7fe640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b008f900 0x7fd3b008fd10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400e810 tx=0x7fd3a4004840 comp rx=0 tx=0).stop 2026-02-17T12:07:26.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd38f7fe640 1 -- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b008f900 msgr2=0x7fd3b008fd10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:26.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd38f7fe640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b008f900 0x7fd3b008fd10 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400e810 tx=0x7fd3a4004840 comp rx=0 tx=0).stop 2026-02-17T12:07:26.215 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T12:07:26.215 INFO:teuthology.orchestra.run.trial077.stdout: "name": "a", 2026-02-17T12:07:26.215 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 0, 2026-02-17T12:07:26.215 INFO:teuthology.orchestra.run.trial077.stdout: "state": "leader", 2026-02-17T12:07:26.215 INFO:teuthology.orchestra.run.trial077.stdout: "election_epoch": 18, 2026-02-17T12:07:26.215 INFO:teuthology.orchestra.run.trial077.stdout: "uptime": 158179, 2026-02-17T12:07:26.215 INFO:teuthology.orchestra.run.trial077.stdout: "quorum": [ 2026-02-17T12:07:26.215 INFO:teuthology.orchestra.run.trial077.stdout: 0, 2026-02-17T12:07:26.215 INFO:teuthology.orchestra.run.trial077.stdout: 1, 2026-02-17T12:07:26.215 INFO:teuthology.orchestra.run.trial077.stdout: 2 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_age": 0, 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: "required_con": "2450521708007866372", 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: "required_mon": [ 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:07:26.216 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_mon": [ 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:07:26.217 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "outside_quorum": [], 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "extra_probe_peers": [], 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "sync_provider": [], 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "monmap": { 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "epoch": 1, 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "fsid": "093d53f2-7cd0-4506-a27d-4c950e190615", 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "modified": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "created": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release": 19, 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release_name": "squid", 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "election_strategy": 1, 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "disallowed_leaders": "", 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false, 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "tiebreaker_mon": "", 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "removed_ranks": "", 2026-02-17T12:07:26.218 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "persistent": [ 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "optional": [] 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "mons": [ 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.219 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 0, 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: "name": "a", 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3300", 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789", 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789/0", 2026-02-17T12:07:26.220 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6789/0", 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 1, 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: "name": "b", 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:3300", 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789", 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.221 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789/0", 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 2, 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: "name": "c", 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3301", 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.222 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790", 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790/0", 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6790/0", 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: "feature_map": { 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: "mon": [ 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:26.223 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: "osd": [ 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: "num": 5 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: "client": [ 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: "num": 3 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: "mgr": [ 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.224 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:26.225 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:07:26.225 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:07:26.225 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.225 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.225 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.225 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false 2026-02-17T12:07:26.225 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T12:07:26.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd3b5741640 1 -- 10.20.193.77:0/1196517048 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd37c03a170 msgr2=0x7fd37c03c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd3b5741640 1 --2- 10.20.193.77:0/1196517048 >> v2:10.20.193.119:6800/4127986552 conn(0x7fd37c03a170 0x7fd37c03c630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3b009c040 tx=0x7fd398007f40 comp rx=0 tx=0).stop 2026-02-17T12:07:26.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd3b5741640 10 monclient: shutdown 2026-02-17T12:07:26.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd3b5741640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:26.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd3b5741640 1 -- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b00a2b60 msgr2=0x7fd3b009ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd3b5741640 1 --2- 10.20.193.77:0/1196517048 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fd3b00a2b60 0x7fd3b009ad70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00af040 tx=0x7fd3a0019670 comp rx=0 tx=0).stop 2026-02-17T12:07:26.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd3af7fe640 1 -- 10.20.193.77:0/1196517048 reap_dead start 2026-02-17T12:07:26.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd3af7fe640 1 -- 10.20.193.77:0/1196517048 reap_dead start 2026-02-17T12:07:26.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd3b5741640 1 -- 10.20.193.77:0/1196517048 shutdown_connections 2026-02-17T12:07:26.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd3b5741640 1 -- 10.20.193.77:0/1196517048 >> 10.20.193.77:0/1196517048 conn(0x7fd3b00a73c0 msgr2=0x7fd3b00a5590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:26.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd3b5741640 1 -- 10.20.193.77:0/1196517048 shutdown_connections 2026-02-17T12:07:26.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.203+0000 7fd3b5741640 1 -- 10.20.193.77:0/1196517048 wait complete. 2026-02-17T12:07:26.227 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:07:26.227 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-17T12:07:26.227 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-17T12:07:26.298 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 10 monclient: get_monmap_and_config 2026-02-17T12:07:26.298 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 10 monclient: build_initial_monmap 2026-02-17T12:07:26.299 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 10 monclient: monmap: 2026-02-17T12:07:26.299 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:26.299 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.299 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:26.295069+0000 2026-02-17T12:07:26.299 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:26.295069+0000 2026-02-17T12:07:26.299 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:26.299 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.299 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:26.299 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:26.299 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:26.299 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:26.299 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:26.299 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.299 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 1 Processor -- start 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 1 -- start start 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 10 monclient: init 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f059809be20 0x7f0598134e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 10 monclient(hunting): picked mon.noname-a con 0x7f059809be20 addr v2:10.20.193.77:3300/0 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f05980a4c20 0x7f05981380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 10 monclient(hunting): picked mon.noname-c con 0x7f05980a4c20 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f05980a5070 addr v1:10.20.193.77:6789/0 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f059809cdf0 con 0x7f05980a5070 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f059809c200 con 0x7f059809be20 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f059809d0d0 con 0x7f05980a4c20 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f05a0158640 10 monclient(hunting): authenticate will time out at 697.970465s 2026-02-17T12:07:26.300 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f059809be20 0x7f0598134e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059e6ce640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f05980a5070 0x7f0598138630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:50476/0 (socket says 10.20.193.77:50476) 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059e6ce640 1 -- 10.20.193.77:0/3282393314 learned_addr learned my addr 10.20.193.77:0/3282393314 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 10 monclient(hunting): get_auth_request con 0x7f059809be20 auth_method 0 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059d6cc640 1 --2- 10.20.193.77:0/3282393314 >> v2:10.20.193.119:3300/0 conn(0x7f05980a4c20 0x7f05981380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059d6cc640 10 monclient(hunting): get_auth_request con 0x7f05980a4c20 auth_method 0 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059d6cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059d6cc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059d6cc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 10 monclient(hunting): handle_auth_done global_id 4440 payload 274 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 1 -- 10.20.193.77:0/3282393314 >> v2:10.20.193.119:3300/0 conn(0x7f05980a4c20 msgr2=0x7f05981380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:26.301 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 1 --2- 10.20.193.77:0/3282393314 >> v2:10.20.193.119:3300/0 conn(0x7f05980a4c20 0x7f05981380f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.302 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 1 -- 10.20.193.77:0/3282393314 >> v1:10.20.193.77:6789/0 conn(0x7f05980a5070 legacy=0x7f0598138630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:26.302 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:26.302 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 1 monclient: found mon.noname-a 2026-02-17T12:07:26.302 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:26.302 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:26.302 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.291+0000 7f059decd640 1 -- 10.20.193.77:0/3282393314 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059809d3b0 con 0x7f059809be20 2026-02-17T12:07:26.309 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059decd640 1 -- 10.20.193.77:0/3282393314 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f059809be20 msgr2=0x7f0598134e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.309 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059decd640 1 --2- 10.20.193.77:0/3282393314 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f059809be20 0x7f0598134e20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f05980a7cb0 tx=0x7f058801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9bffc276fbeb94 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.309 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059cecb640 1 -- 10.20.193.77:0/3282393314 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05880b0070 con 0x7f059809be20 2026-02-17T12:07:26.309 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059cecb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.309 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059cecb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:26.309 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059cecb640 10 monclient: dump: 2026-02-17T12:07:26.309 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.310 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.310 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.310 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.310 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.310 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.310 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.310 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.310 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.310 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059cecb640 10 monclient: _finish_auth 0 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059cecb640 10 monclient: _check_auth_tickets 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059cecb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059cecb640 1 -- 10.20.193.77:0/3282393314 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05880ab600 con 0x7f059809be20 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059cecb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059cecb640 1 -- 10.20.193.77:0/3282393314 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05880ab9d0 con 0x7f059809be20 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 5 monclient: authenticate success, global_id 4440 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059cecb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059cecb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f059cecb640 10 monclient: dump: 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.311 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 4 set_mon_vals no callback set 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 10 monclient: shutdown 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 1 -- 10.20.193.77:0/3282393314 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f059809be20 msgr2=0x7f0598134e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 1 --2- 10.20.193.77:0/3282393314 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f059809be20 0x7f0598134e20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f05980a7cb0 tx=0x7f058801c460 comp rx=0 tx=0).stop 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 1 -- 10.20.193.77:0/3282393314 shutdown_connections 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 1 --2- 10.20.193.77:0/3282393314 >> v2:10.20.193.119:3300/0 conn(0x7f05980a4c20 0x7f05981380f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 1 --2- 10.20.193.77:0/3282393314 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f059809be20 0x7f0598134e20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 1 -- 10.20.193.77:0/3282393314 >> 10.20.193.77:0/3282393314 conn(0x7f0598074ba0 msgr2=0x7f05980aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 1 -- 10.20.193.77:0/3282393314 shutdown_connections 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 1 -- 10.20.193.77:0/3282393314 wait complete. 2026-02-17T12:07:26.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 10 monclient: build_initial_monmap 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 10 monclient: monmap: 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 1 Processor -- start 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 1 -- start start 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 10 monclient: init 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.295+0000 7f05a0158640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809be20 0x7f05981d2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 10 monclient(hunting): picked mon.noname-c con 0x7f059809be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f05980a4c20 0x7f05980a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 10 monclient(hunting): picked mon.noname-a con 0x7f05980a4c20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f05980a5070 0x7f05980a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 10 monclient(hunting): picked mon.noname-b con 0x7f05980a5070 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0598138f50 con 0x7f05980a4c20 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0598142ec0 con 0x7f05980a5070 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0598143040 con 0x7f059809be20 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 10 monclient(hunting): authenticate will time out at 697.976043s 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809be20 0x7f05981d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809be20 0x7f05981d2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:56130/0 (socket says 10.20.193.77:56130) 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 1 -- 10.20.193.77:0/1231306105 learned_addr learned my addr 10.20.193.77:0/1231306105 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 10 monclient(hunting): get_auth_request con 0x7f059809be20 auth_method 0 2026-02-17T12:07:26.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f05980a4c20 0x7f05980a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient(hunting): get_auth_request con 0x7f05980a4c20 auth_method 0 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059e6ce640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f05980a5070 0x7f05980a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 10 monclient(hunting): handle_auth_done global_id 4409 payload 824 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 1 -- 10.20.193.77:0/1231306105 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f05980a5070 msgr2=0x7f05980a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.315 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f05980a5070 0x7f05980a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 1 -- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f05980a4c20 msgr2=0x7f05980a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f05980a4c20 0x7f05980a3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 1 monclient: found mon.noname-c 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 1 -- 10.20.193.77:0/1231306105 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059813fd20 con 0x7f059809be20 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059e6ce640 10 monclient: get_auth_request con 0x7f05980a5070 auth_method 0 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059e6ce640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f05980a5070 0x7f05980a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 1 -- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809be20 msgr2=0x7f05981d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059decd640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809be20 0x7f05981d2120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f058801a090 tx=0x7f0588019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 1 -- 10.20.193.77:0/1231306105 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05880b9020 con 0x7f059809be20 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 10 monclient: dump: 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.316 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 10 monclient: _finish_auth 0 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 10 monclient: _check_auth_tickets 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 1 -- 10.20.193.77:0/1231306105 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05880b5690 con 0x7f059809be20 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 1 -- 10.20.193.77:0/1231306105 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05880b0040 con 0x7f059809be20 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 10 monclient: dump: 2026-02-17T12:07:26.317 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f0587fff640 4 set_mon_vals no callback set 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 5 monclient: authenticate success, global_id 4409 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 10 monclient: _renew_subs 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 1 -- 10.20.193.77:0/1231306105 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f059809f9c0 con 0x7f059809be20 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 10 monclient: _renew_subs 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 1 -- 10.20.193.77:0/1231306105 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f059809e230 con 0x7f059809be20 2026-02-17T12:07:26.318 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809f2f0 0x7f059813e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05a0158640 1 -- 10.20.193.77:0/1231306105 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0598135570 con 0x7f059809f2f0 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809f2f0 0x7f059813e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient: get_auth_request con 0x7f059809f2f0 auth_method 0 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 1 -- 10.20.193.77:0/1231306105 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f05880b5ac0 con 0x7f059809be20 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 10 monclient(hunting): handle_auth_done global_id 4412 payload 824 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059d6cc640 1 -- 10.20.193.77:0/1231306105 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f05981d2660 con 0x7f059809f2f0 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 1 --2- 10.20.193.77:0/1231306105 >> v2:10.20.193.119:6800/4127986552 conn(0x7f056803a120 0x7f056803c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.319 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f05867fc640 1 -- 10.20.193.77:0/1231306105 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f05880e7b30 con 0x7f059809be20 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059e6ce640 1 --2- 10.20.193.77:0/1231306105 >> v2:10.20.193.119:6800/4127986552 conn(0x7f056803a120 0x7f056803c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.299+0000 7f059e6ce640 10 monclient: get_auth_request con 0x7f056803a120 auth_method 0 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.303+0000 7f059d6cc640 1 -- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809f2f0 msgr2=0x7f059813e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.303+0000 7f059d6cc640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809f2f0 0x7f059813e100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f059813f920 tx=0x7f058c011c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.303+0000 7f05867fc640 1 -- 10.20.193.77:0/1231306105 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058c019070 con 0x7f059809f2f0 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.303+0000 7f05867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.303+0000 7f05867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.303+0000 7f05867fc640 10 monclient: dump: 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.320 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.303+0000 7f05867fc640 1 -- 10.20.193.77:0/1231306105 <== mon.2 v2:10.20.193.77:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7f058c00fe50 con 0x7f059809f2f0 2026-02-17T12:07:26.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.303+0000 7f05867fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:26.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.303+0000 7f05867fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:26.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.303+0000 7f05867fc640 1 -- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809f2f0 msgr2=0x7f059813e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.303+0000 7f05867fc640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809f2f0 0x7f059813e100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f059813f920 tx=0x7f058c011c90 comp rx=0 tx=0).stop 2026-02-17T12:07:26.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.303+0000 7f05867fc640 1 -- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809f2f0 msgr2=0x7f059813e100 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:26.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.303+0000 7f05867fc640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809f2f0 0x7f059813e100 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f059813f920 tx=0x7f058c011c90 comp rx=0 tx=0).stop 2026-02-17T12:07:26.321 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.303+0000 7f059e6ce640 1 --2- 10.20.193.77:0/1231306105 >> v2:10.20.193.119:6800/4127986552 conn(0x7f056803a120 0x7f056803c5e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0594005bd0 tx=0x7f0594009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05a0158640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:07:26.322 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05a0158640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059813e640 0x7f05981dd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05a0158640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05a0158640 1 -- 10.20.193.77:0/1231306105 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0598134e20 con 0x7f059813e640 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f059d6cc640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059813e640 0x7f05981dd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f059d6cc640 10 monclient: get_auth_request con 0x7f059813e640 auth_method 0 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f059d6cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f059d6cc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f059d6cc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f059d6cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f059d6cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f059d6cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f059d6cc640 10 monclient(hunting): handle_auth_done global_id 4415 payload 824 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f059d6cc640 1 -- 10.20.193.77:0/1231306105 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f059809e4c0 con 0x7f059813e640 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f059d6cc640 1 -- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059813e640 msgr2=0x7f05981dd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f059d6cc640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059813e640 0x7f05981dd470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f059813f920 tx=0x7f058c004840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05867fc640 1 -- 10.20.193.77:0/1231306105 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058c00f040 con 0x7f059813e640 2026-02-17T12:07:26.323 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05867fc640 10 monclient: dump: 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05867fc640 1 -- 10.20.193.77:0/1231306105 <== mon.2 v2:10.20.193.77:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7f058c015e30 con 0x7f059813e640 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05867fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05867fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05867fc640 1 -- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059813e640 msgr2=0x7f05981dd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.324 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05867fc640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059813e640 0x7f05981dd470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f059813f920 tx=0x7f058c004840 comp rx=0 tx=0).stop 2026-02-17T12:07:26.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05867fc640 1 -- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059813e640 msgr2=0x7f05981dd470 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:26.325 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.307+0000 7f05867fc640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059813e640 0x7f05981dd470 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f059813f920 tx=0x7f058c004840 comp rx=0 tx=0).stop 2026-02-17T12:07:26.325 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T12:07:26.325 INFO:teuthology.orchestra.run.trial077.stdout: "name": "c", 2026-02-17T12:07:26.325 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 2, 2026-02-17T12:07:26.325 INFO:teuthology.orchestra.run.trial077.stdout: "state": "peon", 2026-02-17T12:07:26.325 INFO:teuthology.orchestra.run.trial077.stdout: "election_epoch": 18, 2026-02-17T12:07:26.325 INFO:teuthology.orchestra.run.trial077.stdout: "uptime": 158271, 2026-02-17T12:07:26.325 INFO:teuthology.orchestra.run.trial077.stdout: "quorum": [ 2026-02-17T12:07:26.325 INFO:teuthology.orchestra.run.trial077.stdout: 0, 2026-02-17T12:07:26.325 INFO:teuthology.orchestra.run.trial077.stdout: 1, 2026-02-17T12:07:26.325 INFO:teuthology.orchestra.run.trial077.stdout: 2 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_age": 0, 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "required_con": "2450521708007866372", 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "required_mon": [ 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.326 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_mon": [ 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "outside_quorum": [], 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "extra_probe_peers": [], 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "sync_provider": [], 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "monmap": { 2026-02-17T12:07:26.327 INFO:teuthology.orchestra.run.trial077.stdout: "epoch": 1, 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "fsid": "093d53f2-7cd0-4506-a27d-4c950e190615", 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "modified": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "created": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release": 19, 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release_name": "squid", 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "election_strategy": 1, 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "disallowed_leaders": "", 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false, 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "tiebreaker_mon": "", 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "removed_ranks": "", 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "persistent": [ 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:07:26.328 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: "optional": [] 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: "mons": [ 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 0, 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: "name": "a", 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3300", 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.329 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789", 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789/0", 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6789/0", 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 1, 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "name": "b", 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:3300", 2026-02-17T12:07:26.330 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789", 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789/0", 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 2, 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: "name": "c", 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.331 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3301", 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790", 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790/0", 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6790/0", 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: "feature_map": { 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: "mon": [ 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.332 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: "osd": [ 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: "client": [ 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: "num": 5 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false 2026-02-17T12:07:26.333 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T12:07:26.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.311+0000 7f05a0158640 1 -- 10.20.193.77:0/1231306105 >> v2:10.20.193.119:6800/4127986552 conn(0x7f056803a120 msgr2=0x7f056803c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.311+0000 7f05a0158640 1 --2- 10.20.193.77:0/1231306105 >> v2:10.20.193.119:6800/4127986552 conn(0x7f056803a120 0x7f056803c5e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0594005bd0 tx=0x7f0594009040 comp rx=0 tx=0).stop 2026-02-17T12:07:26.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.311+0000 7f05a0158640 10 monclient: shutdown 2026-02-17T12:07:26.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.311+0000 7f05a0158640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:26.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.311+0000 7f05a0158640 1 -- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809be20 msgr2=0x7f05981d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.311+0000 7f05a0158640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809be20 0x7f05981d2120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f058801a090 tx=0x7f0588019200 comp rx=0 tx=0).stop 2026-02-17T12:07:26.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.311+0000 7f059e6ce640 1 -- 10.20.193.77:0/1231306105 reap_dead start 2026-02-17T12:07:26.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.311+0000 7f05a0158640 1 -- 10.20.193.77:0/1231306105 shutdown_connections 2026-02-17T12:07:26.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.311+0000 7f05a0158640 1 --2- 10.20.193.77:0/1231306105 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f059809be20 0x7f05981d2120 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.311+0000 7f05a0158640 1 -- 10.20.193.77:0/1231306105 >> 10.20.193.77:0/1231306105 conn(0x7f0598074ba0 msgr2=0x7f0598137ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:26.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.311+0000 7f05a0158640 1 -- 10.20.193.77:0/1231306105 shutdown_connections 2026-02-17T12:07:26.335 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.311+0000 7f05a0158640 1 -- 10.20.193.77:0/1231306105 wait complete. 2026-02-17T12:07:26.335 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:07:26.335 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-17T12:07:26.336 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-17T12:07:26.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 10 monclient: get_monmap_and_config 2026-02-17T12:07:26.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 10 monclient: build_initial_monmap 2026-02-17T12:07:26.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 10 monclient: monmap: 2026-02-17T12:07:26.398 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:26.398 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.398 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:26.395434+0000 2026-02-17T12:07:26.398 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:26.395434+0000 2026-02-17T12:07:26.398 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:26.398 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.398 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 1 Processor -- start 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 1 -- start start 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 10 monclient: init 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 10 monclient: _add_conns ranks=[0,2,4,3,1] 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff3080a07d0 addr v1:10.20.193.77:6789/0 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ff3080a2920 0x7ff30813b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 10 monclient(hunting): picked mon.noname-b con 0x7ff3080a2920 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7ff3080a2d00 0x7ff30813def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 10 monclient(hunting): picked mon.noname-c con 0x7ff3080a2d00 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30809d4a0 con 0x7ff3080a07d0 2026-02-17T12:07:26.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff30809ed40 con 0x7ff3080a2d00 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff30809ea60 con 0x7ff3080a2920 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff30de80640 10 monclient(hunting): authenticate will time out at 698.070901s 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff3077fe640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7ff3080a07d0 0x7ff3080a2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:50480/0 (socket says 10.20.193.77:50480) 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff3077fe640 1 -- 10.20.193.77:0/1216980749 learned_addr learned my addr 10.20.193.77:0/1216980749 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 1 --2- 10.20.193.77:0/1216980749 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ff3080a2920 0x7ff30813b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 10 monclient(hunting): get_auth_request con 0x7ff3080a2920 auth_method 0 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 10 monclient(hunting): handle_auth_done global_id 4418 payload 274 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 1 -- 10.20.193.77:0/1216980749 >> v2:10.20.193.119:3300/0 conn(0x7ff3080a2d00 msgr2=0x7ff30813def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:26.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 1 --2- 10.20.193.77:0/1216980749 >> v2:10.20.193.119:3300/0 conn(0x7ff3080a2d00 0x7ff30813def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 1 -- 10.20.193.77:0/1216980749 >> v1:10.20.193.77:6789/0 conn(0x7ff3080a07d0 legacy=0x7ff3080a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:26.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:26.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 1 monclient: found mon.noname-b 2026-02-17T12:07:26.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:26.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:07:26.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.391+0000 7ff306ffd640 1 -- 10.20.193.77:0/1216980749 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30809d720 con 0x7ff3080a2920 2026-02-17T12:07:26.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff306ffd640 1 -- 10.20.193.77:0/1216980749 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ff3080a2920 msgr2=0x7ff30813b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff306ffd640 1 --2- 10.20.193.77:0/1216980749 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ff3080a2920 0x7ff30813b9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80098c0 tx=0x7ff2f801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bdd9116cf4bc86b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff3067fc640 1 -- 10.20.193.77:0/1216980749 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80b0070 con 0x7ff3080a2920 2026-02-17T12:07:26.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff3067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff3067fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:26.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff3067fc640 10 monclient: dump: 2026-02-17T12:07:26.402 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff3067fc640 10 monclient: _finish_auth 0 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff3067fc640 10 monclient: _check_auth_tickets 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff3067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff3067fc640 1 -- 10.20.193.77:0/1216980749 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f80ab600 con 0x7ff3080a2920 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff3067fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff3067fc640 1 -- 10.20.193.77:0/1216980749 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80ab9d0 con 0x7ff3080a2920 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff30de80640 5 monclient: authenticate success, global_id 4418 2026-02-17T12:07:26.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff30de80640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff30de80640 4 set_mon_vals no callback set 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff3067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff3067fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff3067fc640 10 monclient: dump: 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff30de80640 10 monclient: shutdown 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff30de80640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff30de80640 1 -- 10.20.193.77:0/1216980749 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ff3080a2920 msgr2=0x7ff30813b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff30de80640 1 --2- 10.20.193.77:0/1216980749 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ff3080a2920 0x7ff30813b9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80098c0 tx=0x7ff2f801c480 comp rx=0 tx=0).stop 2026-02-17T12:07:26.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff30de80640 1 -- 10.20.193.77:0/1216980749 shutdown_connections 2026-02-17T12:07:26.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff30de80640 1 --2- 10.20.193.77:0/1216980749 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ff3080a2920 0x7ff30813b9a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff30de80640 1 --2- 10.20.193.77:0/1216980749 >> v2:10.20.193.119:3300/0 conn(0x7ff3080a2d00 0x7ff30813def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff30de80640 1 -- 10.20.193.77:0/1216980749 >> 10.20.193.77:0/1216980749 conn(0x7ff3080a73c0 msgr2=0x7ff3080a3300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:26.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff30de80640 1 -- 10.20.193.77:0/1216980749 shutdown_connections 2026-02-17T12:07:26.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.395+0000 7ff30de80640 1 -- 10.20.193.77:0/1216980749 wait complete. 2026-02-17T12:07:26.408 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient: build_initial_monmap 2026-02-17T12:07:26.408 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient: monmap: 2026-02-17T12:07:26.408 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:26.408 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:26.408 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:26.408 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:26.408 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:26.408 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.408 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:26.408 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:26.408 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:26.408 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 1 Processor -- start 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 1 -- start start 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient: init 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7ff3080a07d0 0x7ff308097f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient(hunting): picked mon.noname-a con 0x7ff3080a07d0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff3080a2920 0x7ff30809a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient(hunting): picked mon.noname-b con 0x7ff3080a2920 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ff3080a2d00 0x7ff30809ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient(hunting): picked mon.noname-c con 0x7ff3080a2d00 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff30809f8a0 con 0x7ff3080a07d0 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff30809f720 con 0x7ff3080a2920 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff308140c50 con 0x7ff3080a2d00 2026-02-17T12:07:26.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient(hunting): authenticate will time out at 698.076938s 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7ff3080a07d0 0x7ff308097f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7ff3080a07d0 0x7ff308097f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:55014/0 (socket says 10.20.193.77:55014) 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 1 -- 10.20.193.77:0/3621692305 learned_addr learned my addr 10.20.193.77:0/3621692305 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 10 monclient(hunting): get_auth_request con 0x7ff3080a07d0 auth_method 0 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff307fff640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ff3080a2d00 0x7ff30809ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff307fff640 10 monclient(hunting): get_auth_request con 0x7ff3080a2d00 auth_method 0 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff307fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff307fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff307fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 10 monclient(hunting): handle_auth_done global_id 4446 payload 824 2026-02-17T12:07:26.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 1 -- 10.20.193.77:0/3621692305 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ff3080a2d00 msgr2=0x7ff30809ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ff3080a2d00 0x7ff30809ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 1 -- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff3080a2920 msgr2=0x7ff30809a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff3080a2920 0x7ff30809a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 10 monclient: _finish_hunting 0 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 1 monclient: found mon.noname-a 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 1 -- 10.20.193.77:0/3621692305 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff308097910 con 0x7ff3080a07d0 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff307fff640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7ff3080a2d00 0x7ff30809ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 1 -- 10.20.193.77:0/3621692305 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7ff3080a07d0 msgr2=0x7ff308097f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff3077fe640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7ff3080a07d0 0x7ff308097f60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400c570 tx=0x7ff2f400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff2e3fff640 1 -- 10.20.193.77:0/3621692305 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4007070 con 0x7ff3080a07d0 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff2e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff2e3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff2e3fff640 10 monclient: dump: 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.411 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff2e3fff640 10 monclient: _finish_auth 0 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff2e3fff640 10 monclient: _check_auth_tickets 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff2e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff2e3fff640 1 -- 10.20.193.77:0/3621692305 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f4007210 con 0x7ff3080a07d0 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff2e3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff2e3fff640 1 -- 10.20.193.77:0/3621692305 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4007600 con 0x7ff3080a07d0 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff2e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff2e3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff2e3fff640 10 monclient: dump: 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.412 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff305ffb640 4 set_mon_vals no callback set 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 5 monclient: authenticate success, global_id 4446 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient: _renew_subs 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 1 -- 10.20.193.77:0/3621692305 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff308099f30 con 0x7ff3080a07d0 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient: _renew_subs 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 1 -- 10.20.193.77:0/3621692305 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff308098dc0 con 0x7ff3080a07d0 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.399+0000 7ff30de80640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff30de80640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff308098800 0x7ff30809b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff30de80640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff30de80640 1 -- 10.20.193.77:0/3621692305 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff3080a2210 con 0x7ff308098800 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff306ffd640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff308098800 0x7ff30809b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff2e3fff640 1 -- 10.20.193.77:0/3621692305 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7ff2f401b400 con 0x7ff3080a07d0 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff306ffd640 10 monclient: get_auth_request con 0x7ff308098800 auth_method 0 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff306ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff306ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff306ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff2e3fff640 1 --2- 10.20.193.77:0/3621692305 >> v2:10.20.193.119:6800/4127986552 conn(0x7ff2d803a170 0x7ff2d803c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff2e3fff640 1 -- 10.20.193.77:0/3621692305 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7ff2f404d6b0 con 0x7ff3080a07d0 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff306ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff306ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff306ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff307fff640 1 --2- 10.20.193.77:0/3621692305 >> v2:10.20.193.119:6800/4127986552 conn(0x7ff2d803a170 0x7ff2d803c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff307fff640 10 monclient: get_auth_request con 0x7ff2d803a170 auth_method 0 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff306ffd640 10 monclient(hunting): handle_auth_done global_id 14107 payload 824 2026-02-17T12:07:26.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff306ffd640 1 -- 10.20.193.77:0/3621692305 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff30806d670 con 0x7ff308098800 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff306ffd640 1 -- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff308098800 msgr2=0x7ff30809b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff306ffd640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff308098800 0x7ff30809b2b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff30806ebf0 tx=0x7ff2f80abaa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff2e3fff640 1 -- 10.20.193.77:0/3621692305 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80b9070 con 0x7ff308098800 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff2e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff2e3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff2e3fff640 10 monclient: dump: 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.416 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff307fff640 1 --2- 10.20.193.77:0/3621692305 >> v2:10.20.193.119:6800/4127986552 conn(0x7ff2d803a170 0x7ff2d803c630 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc004500 tx=0x7ff2fc002a70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff2e3fff640 1 -- 10.20.193.77:0/3621692305 <== mon.1 v2:10.20.193.119:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9607 (secure 0 0 0) 0x7ff2f80b5480 con 0x7ff308098800 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff2e3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff2e3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff2e3fff640 1 -- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff308098800 msgr2=0x7ff30809b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff2e3fff640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff308098800 0x7ff30809b2b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff30806ebf0 tx=0x7ff2f80abaa0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff2e3fff640 1 -- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff308098800 msgr2=0x7ff30809b2b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.403+0000 7ff2e3fff640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff308098800 0x7ff30809b2b0 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff30806ebf0 tx=0x7ff2f80abaa0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.407+0000 7ff30de80640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.407+0000 7ff30de80640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff30808fc50 0x7ff3080638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.407+0000 7ff30de80640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.407+0000 7ff30de80640 1 -- 10.20.193.77:0/3621692305 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff3080984a0 con 0x7ff30808fc50 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.407+0000 7ff306ffd640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff30808fc50 0x7ff3080638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.407+0000 7ff306ffd640 10 monclient: get_auth_request con 0x7ff30808fc50 auth_method 0 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.407+0000 7ff306ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.407+0000 7ff306ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.407+0000 7ff306ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.407+0000 7ff306ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.407+0000 7ff306ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.407+0000 7ff306ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.407+0000 7ff306ffd640 10 monclient(hunting): handle_auth_done global_id 14110 payload 824 2026-02-17T12:07:26.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.407+0000 7ff306ffd640 1 -- 10.20.193.77:0/3621692305 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff308099000 con 0x7ff30808fc50 2026-02-17T12:07:26.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff306ffd640 1 -- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff30808fc50 msgr2=0x7ff3080638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff306ffd640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff30808fc50 0x7ff3080638d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80098c0 tx=0x7ff2f80a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff2e3fff640 1 -- 10.20.193.77:0/3621692305 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80b9040 con 0x7ff30808fc50 2026-02-17T12:07:26.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff2e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff2e3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff2e3fff640 10 monclient: dump: 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff2e3fff640 1 -- 10.20.193.77:0/3621692305 <== mon.1 v2:10.20.193.119:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4540 (secure 0 0 0) 0x7ff2f80c7430 con 0x7ff30808fc50 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff2e3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff2e3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff2e3fff640 1 -- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff30808fc50 msgr2=0x7ff3080638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff2e3fff640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff30808fc50 0x7ff3080638d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80098c0 tx=0x7ff2f80a8000 comp rx=0 tx=0).stop 2026-02-17T12:07:26.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff2e3fff640 1 -- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff30808fc50 msgr2=0x7ff3080638d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:26.420 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff2e3fff640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7ff30808fc50 0x7ff3080638d0 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80098c0 tx=0x7ff2f80a8000 comp rx=0 tx=0).stop 2026-02-17T12:07:26.420 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T12:07:26.420 INFO:teuthology.orchestra.run.trial077.stdout: "name": "b", 2026-02-17T12:07:26.420 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 1, 2026-02-17T12:07:26.420 INFO:teuthology.orchestra.run.trial077.stdout: "state": "peon", 2026-02-17T12:07:26.420 INFO:teuthology.orchestra.run.trial077.stdout: "election_epoch": 18, 2026-02-17T12:07:26.420 INFO:teuthology.orchestra.run.trial077.stdout: "uptime": 15446, 2026-02-17T12:07:26.420 INFO:teuthology.orchestra.run.trial077.stdout: "quorum": [ 2026-02-17T12:07:26.420 INFO:teuthology.orchestra.run.trial077.stdout: 0, 2026-02-17T12:07:26.420 INFO:teuthology.orchestra.run.trial077.stdout: 1, 2026-02-17T12:07:26.420 INFO:teuthology.orchestra.run.trial077.stdout: 2 2026-02-17T12:07:26.420 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.420 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_age": 0, 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "required_con": "2450521708007866372", 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "required_mon": [ 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_con": "4540701547738038271", 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "quorum_mon": [ 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:07:26.421 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "outside_quorum": [], 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "extra_probe_peers": [], 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "sync_provider": [], 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "monmap": { 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "epoch": 1, 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "fsid": "093d53f2-7cd0-4506-a27d-4c950e190615", 2026-02-17T12:07:26.422 INFO:teuthology.orchestra.run.trial077.stdout: "modified": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "created": "2026-02-17T12:04:22.035180Z", 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release": 19, 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "min_mon_release_name": "squid", 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "election_strategy": 1, 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "disallowed_leaders": "", 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false, 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "tiebreaker_mon": "", 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "removed_ranks": "", 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "features": { 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "persistent": [ 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "kraken", 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "luminous", 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "mimic", 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "osdmap-prune", 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "nautilus", 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "octopus", 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "pacific", 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "elector-pinging", 2026-02-17T12:07:26.423 INFO:teuthology.orchestra.run.trial077.stdout: "quincy", 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: "reef", 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: "squid" 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: "optional": [] 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: "mons": [ 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 0, 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: "name": "a", 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3300", 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:07:26.424 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789", 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6789/0", 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6789/0", 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 1, 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: "name": "b", 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:3300", 2026-02-17T12:07:26.425 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789", 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.119:6789/0", 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: "rank": 2, 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: "name": "c", 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: "public_addrs": { 2026-02-17T12:07:26.426 INFO:teuthology.orchestra.run.trial077.stdout: "addrvec": [ 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v2", 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:3301", 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: "type": "v1", 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790", 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: "nonce": 0 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: "addr": "10.20.193.77:6790/0", 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: "public_addr": "10.20.193.77:6790/0", 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: "priority": 0, 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: "weight": 0, 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: "crush_location": "{}" 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.427 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: "feature_map": { 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: "mon": [ 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: ], 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: "client": [ 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: { 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: "features": "0x3f03cffffffdffff", 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: "release": "squid", 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: "num": 1 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: } 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: ] 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: }, 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout: "stretch_mode": false 2026-02-17T12:07:26.428 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T12:07:26.429 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff30de80640 1 -- 10.20.193.77:0/3621692305 >> v2:10.20.193.119:6800/4127986552 conn(0x7ff2d803a170 msgr2=0x7ff2d803c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.429 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff30de80640 1 --2- 10.20.193.77:0/3621692305 >> v2:10.20.193.119:6800/4127986552 conn(0x7ff2d803a170 0x7ff2d803c630 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc004500 tx=0x7ff2fc002a70 comp rx=0 tx=0).stop 2026-02-17T12:07:26.429 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff30de80640 10 monclient: shutdown 2026-02-17T12:07:26.429 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff30de80640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:26.430 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff30de80640 1 -- 10.20.193.77:0/3621692305 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7ff3080a07d0 msgr2=0x7ff308097f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.430 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff30de80640 1 --2- 10.20.193.77:0/3621692305 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7ff3080a07d0 0x7ff308097f60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400c570 tx=0x7ff2f400ca30 comp rx=0 tx=0).stop 2026-02-17T12:07:26.430 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff307fff640 1 -- 10.20.193.77:0/3621692305 reap_dead start 2026-02-17T12:07:26.430 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff307fff640 1 -- 10.20.193.77:0/3621692305 reap_dead start 2026-02-17T12:07:26.430 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff30de80640 1 -- 10.20.193.77:0/3621692305 shutdown_connections 2026-02-17T12:07:26.430 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff30de80640 1 -- 10.20.193.77:0/3621692305 >> 10.20.193.77:0/3621692305 conn(0x7ff3080a73c0 msgr2=0x7ff30808d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:26.430 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff30de80640 1 -- 10.20.193.77:0/3621692305 shutdown_connections 2026-02-17T12:07:26.430 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.411+0000 7ff30de80640 1 -- 10.20.193.77:0/3621692305 wait complete. 2026-02-17T12:07:26.430 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-17T12:07:26.430 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-17T12:07:26.430 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-17T12:07:26.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 10 monclient: get_monmap_and_config 2026-02-17T12:07:26.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 10 monclient: build_initial_monmap 2026-02-17T12:07:26.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 10 monclient: monmap: 2026-02-17T12:07:26.500 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:26.500 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.500 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:26.499131+0000 2026-02-17T12:07:26.500 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:26.499131+0000 2026-02-17T12:07:26.501 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:26.501 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.501 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:26.501 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:26.501 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:26.501 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:26.501 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:26.501 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.502 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 1 Processor -- start 2026-02-17T12:07:26.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 1 -- start start 2026-02-17T12:07:26.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 10 monclient: init 2026-02-17T12:07:26.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:26.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 10 monclient: _add_conns ranks=[4,0,2,3,1] 2026-02-17T12:07:26.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f0a281363a0 0x7f0a28073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 10 monclient(hunting): picked mon.noname-c con 0x7f0a281363a0 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:26.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0a28136780 addr v1:10.20.193.77:6789/0 2026-02-17T12:07:26.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136b90 0x7f0a280a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 10 monclient(hunting): picked mon.noname-b con 0x7f0a28136b90 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:26.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a28072f10 con 0x7f0a28136780 2026-02-17T12:07:26.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0a280731f0 con 0x7f0a281363a0 2026-02-17T12:07:26.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0a280734d0 con 0x7f0a28136b90 2026-02-17T12:07:26.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:26.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ecb0640 10 monclient(hunting): authenticate will time out at 698.174960s 2026-02-17T12:07:26.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a1ffff640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f0a28136780 0x7f0a280a3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:50494/0 (socket says 10.20.193.77:50494) 2026-02-17T12:07:26.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a1ffff640 1 -- 10.20.193.77:0/717285799 learned_addr learned my addr 10.20.193.77:0/717285799 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:07:26.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 1 --2- 10.20.193.77:0/717285799 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136b90 0x7f0a280a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 10 monclient(hunting): get_auth_request con 0x7f0a28136b90 auth_method 0 2026-02-17T12:07:26.504 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ca25640 1 --2- 10.20.193.77:0/717285799 >> v2:10.20.193.119:3300/0 conn(0x7f0a281363a0 0x7f0a28073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ca25640 10 monclient(hunting): get_auth_request con 0x7f0a281363a0 auth_method 0 2026-02-17T12:07:26.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ca25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ca25640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2ca25640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 10 monclient(hunting): handle_auth_done global_id 4424 payload 274 2026-02-17T12:07:26.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 1 -- 10.20.193.77:0/717285799 >> v2:10.20.193.119:3300/0 conn(0x7f0a281363a0 msgr2=0x7f0a28073bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:26.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 1 --2- 10.20.193.77:0/717285799 >> v2:10.20.193.119:3300/0 conn(0x7f0a281363a0 0x7f0a28073bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 1 -- 10.20.193.77:0/717285799 >> v1:10.20.193.77:6789/0 conn(0x7f0a28136780 legacy=0x7f0a280a3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:26.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 10 monclient: _finish_hunting 0 2026-02-17T12:07:26.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 1 monclient: found mon.noname-b 2026-02-17T12:07:26.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:26.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:07:26.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.495+0000 7f0a2d226640 1 -- 10.20.193.77:0/717285799 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a28074110 con 0x7f0a28136b90 2026-02-17T12:07:26.510 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2d226640 1 -- 10.20.193.77:0/717285799 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136b90 msgr2=0x7f0a280a39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2d226640 1 --2- 10.20.193.77:0/717285799 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136b90 0x7f0a280a39a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009d90 tx=0x7f0a2401c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69494bc970f9b8fd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a1f7fe640 1 -- 10.20.193.77:0/717285799 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a240b2070 con 0x7f0a28136b90 2026-02-17T12:07:26.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a1f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:26.511 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a1f7fe640 10 monclient: dump: 2026-02-17T12:07:26.511 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.511 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.511 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.511 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.511 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.511 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.511 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.511 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.511 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a1f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a1f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a1f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a1f7fe640 1 -- 10.20.193.77:0/717285799 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a240a5830 con 0x7f0a28136b90 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2ecb0640 5 monclient: authenticate success, global_id 4424 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2ecb0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a1f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a1f7fe640 1 -- 10.20.193.77:0/717285799 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28072500 con 0x7f0a28136b90 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2ecb0640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2ecb0640 4 set_mon_vals no callback set 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a1f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a1f7fe640 10 monclient: dump: 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.512 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2ecb0640 10 monclient: shutdown 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2ecb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/717285799 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136b90 msgr2=0x7f0a280a39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2ecb0640 1 --2- 10.20.193.77:0/717285799 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136b90 0x7f0a280a39a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009d90 tx=0x7f0a2401c850 comp rx=0 tx=0).stop 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/717285799 shutdown_connections 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2ecb0640 1 --2- 10.20.193.77:0/717285799 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136b90 0x7f0a280a39a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2ecb0640 1 --2- 10.20.193.77:0/717285799 >> v2:10.20.193.119:3300/0 conn(0x7f0a281363a0 0x7f0a28073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/717285799 >> 10.20.193.77:0/717285799 conn(0x7f0a280a8890 msgr2=0x7f0a280a8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:26.513 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/717285799 shutdown_connections 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.499+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/717285799 wait complete. 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient: build_initial_monmap 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient: monmap: 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 1 Processor -- start 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 1 -- start start 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient: init 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:26.514 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a281363a0 0x7f0a281d2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient(hunting): picked mon.noname-a con 0x7f0a281363a0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136780 0x7f0a281346e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient(hunting): picked mon.noname-c con 0x7f0a28136780 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0a28136b90 0x7f0a2809dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient(hunting): picked mon.noname-b con 0x7f0a28136b90 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0a28140ad0 con 0x7f0a281363a0 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0a280a40f0 con 0x7f0a28136b90 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0a28140c50 con 0x7f0a28136780 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient(hunting): authenticate will time out at 698.180622s 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ca25640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a281363a0 0x7f0a281d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136780 0x7f0a281346e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136780 0x7f0a281346e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:56188/0 (socket says 10.20.193.77:56188) 2026-02-17T12:07:26.515 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ca25640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a281363a0 0x7f0a281d2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:55022/0 (socket says 10.20.193.77:55022) 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 1 -- 10.20.193.77:0/3132897212 learned_addr learned my addr 10.20.193.77:0/3132897212 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 10 monclient(hunting): get_auth_request con 0x7f0a28136780 auth_method 0 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ca25640 10 monclient(hunting): get_auth_request con 0x7f0a281363a0 auth_method 0 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ca25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ca25640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ca25640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ca25640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ca25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ca25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:26.516 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 10 monclient(hunting): handle_auth_done global_id 4427 payload 824 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 1 -- 10.20.193.77:0/3132897212 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0a28136b90 msgr2=0x7f0a2809dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 1 --2- 10.20.193.77:0/3132897212 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0a28136b90 0x7f0a2809dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 1 -- 10.20.193.77:0/3132897212 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a281363a0 msgr2=0x7f0a281d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 1 --2- 10.20.193.77:0/3132897212 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a281363a0 0x7f0a281d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 10 monclient: _finish_hunting 0 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 1 monclient: found mon.noname-c 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 1 -- 10.20.193.77:0/3132897212 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a280a7b90 con 0x7f0a28136780 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 1 -- 10.20.193.77:0/3132897212 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136780 msgr2=0x7f0a281346e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1ffff640 1 --2- 10.20.193.77:0/3132897212 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136780 0x7f0a281346e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000c570 tx=0x7f0a1000ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1d7fa640 1 -- 10.20.193.77:0/3132897212 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10007070 con 0x7f0a28136780 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1d7fa640 10 monclient: dump: 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.517 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1d7fa640 10 monclient: _finish_auth 0 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1d7fa640 10 monclient: _check_auth_tickets 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1d7fa640 1 -- 10.20.193.77:0/3132897212 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10007210 con 0x7f0a28136780 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1d7fa640 1 -- 10.20.193.77:0/3132897212 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10007600 con 0x7f0a28136780 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1d7fa640 10 monclient: dump: 2026-02-17T12:07:26.518 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a1effd640 4 set_mon_vals no callback set 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 5 monclient: authenticate success, global_id 4427 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient: _renew_subs 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/3132897212 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a28120db0 con 0x7f0a28136780 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient: _renew_subs 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/3132897212 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a2811f900 con 0x7f0a28136780 2026-02-17T12:07:26.519 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:26.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:26.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:26.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.503+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/3132897212 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a2806da10 con 0x7f0a28136780 2026-02-17T12:07:26.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.507+0000 7f0a1d7fa640 1 -- 10.20.193.77:0/3132897212 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f0a1001b400 con 0x7f0a28136780 2026-02-17T12:07:26.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.507+0000 7f0a1d7fa640 1 --2- 10.20.193.77:0/3132897212 >> v2:10.20.193.119:6800/4127986552 conn(0x7f09f803a170 0x7f09f803c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:26.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.507+0000 7f0a1d7fa640 1 -- 10.20.193.77:0/3132897212 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f0a1004d620 con 0x7f0a28136780 2026-02-17T12:07:26.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.507+0000 7f0a2ca25640 1 --2- 10.20.193.77:0/3132897212 >> v2:10.20.193.119:6800/4127986552 conn(0x7f09f803a170 0x7f09f803c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:26.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.507+0000 7f0a2ca25640 10 monclient: get_auth_request con 0x7f09f803a170 auth_method 0 2026-02-17T12:07:26.520 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.507+0000 7f0a2ca25640 1 --2- 10.20.193.77:0/3132897212 >> v2:10.20.193.119:6800/4127986552 conn(0x7f09f803a170 0x7f09f803c630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009a50 tx=0x7f0a18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:26.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.511+0000 7f0a1d7fa640 1 -- 10.20.193.77:0/3132897212 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f0a1001b9b0 con 0x7f0a28136780 2026-02-17T12:07:26.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.511+0000 7f0a1d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:26.521 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.511+0000 7f0a1d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:26.617 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.611+0000 7f0a2ecb0640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-17T12:07:26.617 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.611+0000 7f0a2ecb0640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-17T12:07:26.617 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.611+0000 7f0a2ecb0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:26.617 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.611+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/3132897212 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f0a2811f680 con 0x7f0a28136780 2026-02-17T12:07:26.618 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.611+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:26.618 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.611+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=7,config=2,health=11,kv=14,logm=66} crc {auth=194666560,config=1097430493,health=588522927,kv=2511009427,logm=4049124957}) 2026-02-17T12:07:26.618 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.611+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=7,config=2,health=12,kv=14,logm=65} crc {auth=1425187585,config=1097430493,health=3897446751,kv=417758453,logm=4021673314}) 2026-02-17T12:07:26.618 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.611+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:26.618 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.611+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=7,config=2,health=11,kv=14,logm=66} crc {auth=194666560,config=1097430493,health=588522927,kv=2511009427,logm=4049124957}) 2026-02-17T12:07:26.618 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.611+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=8,config=1,health=11,kv=15,logm=65} crc {auth=1819430093,config=1228700967,health=588522927,kv=1867664437,logm=3957430013}) 2026-02-17T12:07:26.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.611+0000 7f0a1d7fa640 1 -- 10.20.193.77:0/3132897212 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f0a10019300 con 0x7f0a28136780 2026-02-17T12:07:26.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.611+0000 7f0a1d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-17T12:07:26.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.611+0000 7f0a1d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:26.620 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.611+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:26.620 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.611+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1092230892}) 2026-02-17T12:07:26.620 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.611+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2944630152}) 2026-02-17T12:07:26.620 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.611+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:26.620 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.611+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1092230892}) 2026-02-17T12:07:26.620 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.611+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3529383213}) 2026-02-17T12:07:26.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.615+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/3132897212 >> v2:10.20.193.119:6800/4127986552 conn(0x7f09f803a170 msgr2=0x7f09f803c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.615+0000 7f0a2ecb0640 1 --2- 10.20.193.77:0/3132897212 >> v2:10.20.193.119:6800/4127986552 conn(0x7f09f803a170 0x7f09f803c630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009a50 tx=0x7f0a18008040 comp rx=0 tx=0).stop 2026-02-17T12:07:26.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.615+0000 7f0a2ecb0640 10 monclient: shutdown 2026-02-17T12:07:26.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.615+0000 7f0a2ecb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:26.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.615+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/3132897212 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136780 msgr2=0x7f0a281346e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:26.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.615+0000 7f0a2ecb0640 1 --2- 10.20.193.77:0/3132897212 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136780 0x7f0a281346e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000c570 tx=0x7f0a1000ca30 comp rx=0 tx=0).stop 2026-02-17T12:07:26.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.615+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/3132897212 shutdown_connections 2026-02-17T12:07:26.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.615+0000 7f0a2ecb0640 1 --2- 10.20.193.77:0/3132897212 >> v2:10.20.193.119:6800/4127986552 conn(0x7f09f803a170 0x7f09f803c630 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.615+0000 7f0a2ecb0640 1 --2- 10.20.193.77:0/3132897212 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f0a28136b90 0x7f0a2809dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.615+0000 7f0a2ecb0640 1 --2- 10.20.193.77:0/3132897212 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f0a28136780 0x7f0a281346e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.615+0000 7f0a2ecb0640 1 --2- 10.20.193.77:0/3132897212 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f0a281363a0 0x7f0a281d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:26.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.615+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/3132897212 >> 10.20.193.77:0/3132897212 conn(0x7f0a280a8890 msgr2=0x7f0a2813d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:26.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.615+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/3132897212 shutdown_connections 2026-02-17T12:07:26.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:26.615+0000 7f0a2ecb0640 1 -- 10.20.193.77:0/3132897212 wait complete. 2026-02-17T12:07:26.624 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:26.624 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3837069878}) 2026-02-17T12:07:26.624 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1008231540}) 2026-02-17T12:07:26.624 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:26.624 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3837069878}) 2026-02-17T12:07:26.624 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3812547951}) 2026-02-17T12:07:26.624 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:26.624 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=711778961}) 2026-02-17T12:07:26.624 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4174258402}) 2026-02-17T12:07:26.624 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:26.625 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=711778961}) 2026-02-17T12:07:26.625 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=457174815}) 2026-02-17T12:07:26.625 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:26.625 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=86,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=2} crc {logm=3971044614,mdsmap=2301609903,mgr=3072640079,mgr_command_descs=1145137710,mgrstat=3277396569}) 2026-02-17T12:07:26.625 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=84,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=3703852606,mdsmap=2301609903,mgr=373015633,mgr_command_descs=1145137710,mgr_metadata=1680101929,mgrstat=1567371954}) 2026-02-17T12:07:26.625 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:26.625 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=86,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=2} crc {logm=3971044614,mdsmap=2301609903,mgr=3072640079,mgr_command_descs=1145137710,mgrstat=3277396569}) 2026-02-17T12:07:26.625 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=87,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=1} crc {logm=1248765794,mdsmap=2301609903,mgr=2119777686,mgr_command_descs=1145137710,mgr_metadata=1680101929,mgrstat=940862914}) 2026-02-17T12:07:26.625 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:26.625 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=10,mon_config_key=20,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=58} crc {mgrstat=871931305,mon_config_key=1736170389,monmap=1302501238,osd_metadata=2739478545,osd_pg_creating=2976546771,osd_snap=4133920409,osdmap=2860948513}) 2026-02-17T12:07:26.625 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgrstat=10,mon_config_key=21,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=57} crc {mgrstat=871931305,mon_config_key=1180043322,monmap=1302501238,osd_metadata=1885382035,osd_pg_creating=2976546771,osd_snap=4133920409,osdmap=2550367110}) 2026-02-17T12:07:26.625 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-17T12:07:26.625 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=10,mon_config_key=20,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=58} crc {mgrstat=871931305,mon_config_key=1736170389,monmap=1302501238,osd_metadata=2739478545,osd_pg_creating=2976546771,osd_snap=4133920409,osdmap=2860948513}) 2026-02-17T12:07:26.626 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T12:07:26.615+0000 7f2ea15a4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=10,mon_config_key=21,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=57} crc {mgrstat=871931305,mon_config_key=3490706636,monmap=1302501238,osd_metadata=2739478545,osd_pg_creating=2976546771,osd_snap=4133920409,osdmap=650420673}) 2026-02-17T12:07:26.628 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-17T12:07:27.629 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-17T12:07:27.629 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:07:27.700 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 10 monclient: get_monmap_and_config 2026-02-17T12:07:27.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 10 monclient: build_initial_monmap 2026-02-17T12:07:27.701 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 10 monclient: monmap: 2026-02-17T12:07:27.701 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:27.701 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:27.701 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:27.699331+0000 2026-02-17T12:07:27.701 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:27.699331+0000 2026-02-17T12:07:27.701 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:27.701 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:27.701 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:27.701 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:27.702 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:27.702 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:27.702 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:27.702 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:27.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 1 Processor -- start 2026-02-17T12:07:27.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 1 -- start start 2026-02-17T12:07:27.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 10 monclient: init 2026-02-17T12:07:27.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:27.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2026-02-17T12:07:27.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 0x7f600809ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:27.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 10 monclient(hunting): picked mon.noname-b con 0x7f600809c8c0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:27.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f600809d560 addr v1:10.20.193.119:6789/0 2026-02-17T12:07:27.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f600809faa0 0x7f600813c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:27.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 10 monclient(hunting): picked mon.noname-c con 0x7f600809faa0 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:27.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600809cca0 con 0x7f600809d560 2026-02-17T12:07:27.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:27.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f6008074c50 con 0x7f600809faa0 2026-02-17T12:07:27.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:27.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f600809ff30 con 0x7f600809c8c0 2026-02-17T12:07:27.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:27.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f600d6d1640 10 monclient(hunting): authenticate will time out at 699.375011s 2026-02-17T12:07:27.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 0x7f600809ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:27.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 0x7f600809ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:56194/0 (socket says 10.20.193.77:56194) 2026-02-17T12:07:27.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 1 -- 10.20.193.77:0/3290355430 learned_addr learned my addr 10.20.193.77:0/3290355430 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:27.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 10 monclient(hunting): get_auth_request con 0x7f600809c8c0 auth_method 0 2026-02-17T12:07:27.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:27.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:27.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:27.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:27.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:27.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:27.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f60077fe640 1 --2- 10.20.193.77:0/3290355430 >> v2:10.20.193.119:3300/0 conn(0x7f600809faa0 0x7f600813c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:27.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 10 monclient(hunting): handle_auth_done global_id 4430 payload 274 2026-02-17T12:07:27.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 1 -- 10.20.193.77:0/3290355430 >> v2:10.20.193.119:3300/0 conn(0x7f600809faa0 msgr2=0x7f600813c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:27.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 1 --2- 10.20.193.77:0/3290355430 >> v2:10.20.193.119:3300/0 conn(0x7f600809faa0 0x7f600813c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 1 -- 10.20.193.77:0/3290355430 >> v1:10.20.193.119:6789/0 conn(0x7f600809d560 legacy=0x7f600809f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:27.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:27.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 1 monclient: found mon.noname-b 2026-02-17T12:07:27.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:27.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:07:27.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f6006ffd640 1 -- 10.20.193.77:0/3290355430 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60080a2c90 con 0x7f600809c8c0 2026-02-17T12:07:27.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f60077fe640 10 monclient: get_auth_request con 0x7f600809faa0 auth_method 0 2026-02-17T12:07:27.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.695+0000 7f60077fe640 1 --2- 10.20.193.77:0/3290355430 >> v2:10.20.193.119:3300/0 conn(0x7f600809faa0 0x7f600813c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:07:27.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6006ffd640 1 -- 10.20.193.77:0/3290355430 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 msgr2=0x7f600809ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:27.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6006ffd640 1 --2- 10.20.193.77:0/3290355430 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 0x7f600809ee50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009970 tx=0x7f5ffc01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d689e07091b7de92 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:27.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6005ffb640 1 -- 10.20.193.77:0/3290355430 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0af070 con 0x7f600809c8c0 2026-02-17T12:07:27.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6005ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:27.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6005ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:27.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6005ffb640 10 monclient: dump: 2026-02-17T12:07:27.710 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:27.710 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:27.710 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.710 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.710 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:27.710 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:27.710 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:27.710 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:27.710 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:27.710 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:27.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6005ffb640 10 monclient: _finish_auth 0 2026-02-17T12:07:27.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6005ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:07:27.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6005ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:27.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6005ffb640 1 -- 10.20.193.77:0/3290355430 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ffc004230 con 0x7f600809c8c0 2026-02-17T12:07:27.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6005ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:27.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6005ffb640 1 -- 10.20.193.77:0/3290355430 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc003720 con 0x7f600809c8c0 2026-02-17T12:07:27.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6005ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:27.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6005ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:27.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f6005ffb640 10 monclient: dump: 2026-02-17T12:07:27.711 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:27.711 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:27.711 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.712 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.712 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:27.712 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:27.712 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:27.712 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:27.712 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:27.712 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:27.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 5 monclient: authenticate success, global_id 4430 2026-02-17T12:07:27.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:27.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 4 set_mon_vals no callback set 2026-02-17T12:07:27.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 10 monclient: shutdown 2026-02-17T12:07:27.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:27.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 1 -- 10.20.193.77:0/3290355430 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 msgr2=0x7f600809ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:27.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 1 --2- 10.20.193.77:0/3290355430 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 0x7f600809ee50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009970 tx=0x7f5ffc01c510 comp rx=0 tx=0).stop 2026-02-17T12:07:27.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 1 -- 10.20.193.77:0/3290355430 shutdown_connections 2026-02-17T12:07:27.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 1 --2- 10.20.193.77:0/3290355430 >> v2:10.20.193.119:3300/0 conn(0x7f600809faa0 0x7f600813c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 1 --2- 10.20.193.77:0/3290355430 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 0x7f600809ee50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 1 -- 10.20.193.77:0/3290355430 >> 10.20.193.77:0/3290355430 conn(0x7f60080a3700 msgr2=0x7f60080a3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:27.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 1 -- 10.20.193.77:0/3290355430 shutdown_connections 2026-02-17T12:07:27.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 1 -- 10.20.193.77:0/3290355430 wait complete. 2026-02-17T12:07:27.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 10 monclient: build_initial_monmap 2026-02-17T12:07:27.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 10 monclient: monmap: 2026-02-17T12:07:27.713 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:27.713 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:27.713 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:27.714 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:27.714 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:27.714 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:27.714 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:27.714 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:27.714 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:27.714 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:27.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 1 Processor -- start 2026-02-17T12:07:27.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 1 -- start start 2026-02-17T12:07:27.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.699+0000 7f600d6d1640 10 monclient: init 2026-02-17T12:07:27.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:27.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:07:27.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 0x7f60081374e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:27.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient(hunting): picked mon.noname-c con 0x7f600809c8c0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:27.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f600809d560 0x7f600806f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:27.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient(hunting): picked mon.noname-b con 0x7f600809d560 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:27.719 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f600809faa0 0x7f600806fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:27.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient(hunting): picked mon.noname-a con 0x7f600809faa0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:27.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:27.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f600806ebd0 con 0x7f600809faa0 2026-02-17T12:07:27.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:27.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f600806ea50 con 0x7f600809d560 2026-02-17T12:07:27.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:27.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f600813f700 con 0x7f600809c8c0 2026-02-17T12:07:27.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:27.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient(hunting): authenticate will time out at 699.380347s 2026-02-17T12:07:27.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 0x7f60081374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:27.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 0x7f60081374e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:56196/0 (socket says 10.20.193.77:56196) 2026-02-17T12:07:27.720 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 1 -- 10.20.193.77:0/3766822121 learned_addr learned my addr 10.20.193.77:0/3766822121 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:27.721 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 10 monclient(hunting): get_auth_request con 0x7f600809c8c0 auth_method 0 2026-02-17T12:07:27.721 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:27.721 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:27.721 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:27.721 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:27.721 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:27.721 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:27.721 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f60077fe640 1 --2- 10.20.193.77:0/3766822121 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f600809faa0 0x7f600806fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:27.721 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f60077fe640 10 monclient(hunting): get_auth_request con 0x7f600809faa0 auth_method 0 2026-02-17T12:07:27.721 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f60077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:27.721 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f60077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:27.721 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f60077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:27.721 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f60077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:27.722 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f60077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:27.722 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f60077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:27.722 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 10 monclient(hunting): handle_auth_done global_id 4433 payload 824 2026-02-17T12:07:27.722 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 1 -- 10.20.193.77:0/3766822121 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f600809d560 msgr2=0x7f600806f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:27.722 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 1 --2- 10.20.193.77:0/3766822121 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f600809d560 0x7f600806f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.722 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 1 -- 10.20.193.77:0/3766822121 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f600809faa0 msgr2=0x7f600806fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:27.722 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 1 --2- 10.20.193.77:0/3766822121 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f600809faa0 0x7f600806fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.722 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:27.722 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 1 monclient: found mon.noname-c 2026-02-17T12:07:27.722 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:27.722 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:27.722 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 1 -- 10.20.193.77:0/3766822121 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6008071200 con 0x7f600809c8c0 2026-02-17T12:07:27.722 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 1 -- 10.20.193.77:0/3766822121 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 msgr2=0x7f60081374e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:27.723 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f6006ffd640 1 --2- 10.20.193.77:0/3766822121 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 0x7f60081374e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009970 tx=0x7f5ffc0192b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:27.723 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 1 -- 10.20.193.77:0/3766822121 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0b8070 con 0x7f600809c8c0 2026-02-17T12:07:27.723 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:27.723 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:27.723 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 10 monclient: dump: 2026-02-17T12:07:27.723 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:27.723 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:27.723 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.723 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.723 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:27.723 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:27.723 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:27.724 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:27.724 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:27.724 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:27.724 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 10 monclient: _finish_auth 0 2026-02-17T12:07:27.724 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 10 monclient: _check_auth_tickets 2026-02-17T12:07:27.724 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:27.724 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 1 -- 10.20.193.77:0/3766822121 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ffc003cf0 con 0x7f600809c8c0 2026-02-17T12:07:27.724 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:27.724 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 1 -- 10.20.193.77:0/3766822121 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0af040 con 0x7f600809c8c0 2026-02-17T12:07:27.724 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:27.724 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:27.724 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f60057fa640 4 set_mon_vals no callback set 2026-02-17T12:07:27.725 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 10 monclient: dump: 2026-02-17T12:07:27.725 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:27.725 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:27.725 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.725 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.725 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:27.725 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:27.725 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:27.725 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:27.725 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:27.725 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:27.725 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 5 monclient: authenticate success, global_id 4433 2026-02-17T12:07:27.725 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient: _renew_subs 2026-02-17T12:07:27.726 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:27.726 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 1 -- 10.20.193.77:0/3766822121 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600809d9f0 con 0x7f600809c8c0 2026-02-17T12:07:27.726 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient: _renew_subs 2026-02-17T12:07:27.726 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:27.726 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 1 -- 10.20.193.77:0/3766822121 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6008131a40 con 0x7f600809c8c0 2026-02-17T12:07:27.726 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:27.726 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:27.726 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:27.726 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f600d6d1640 1 -- 10.20.193.77:0/3766822121 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60080a4890 con 0x7f600809c8c0 2026-02-17T12:07:27.726 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 1 -- 10.20.193.77:0/3766822121 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f5ffc0aa730 con 0x7f600809c8c0 2026-02-17T12:07:27.726 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 1 --2- 10.20.193.77:0/3766822121 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5fd403a170 0x7f5fd403c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:27.726 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.703+0000 7f5fe77fe640 1 -- 10.20.193.77:0/3766822121 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f5ffc0e7c50 con 0x7f600809c8c0 2026-02-17T12:07:27.727 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.707+0000 7f60067fc640 1 --2- 10.20.193.77:0/3766822121 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5fd403a170 0x7f5fd403c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:27.727 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.707+0000 7f60067fc640 10 monclient: get_auth_request con 0x7f5fd403a170 auth_method 0 2026-02-17T12:07:27.727 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.707+0000 7f5fe77fe640 1 -- 10.20.193.77:0/3766822121 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f5ffc016250 con 0x7f600809c8c0 2026-02-17T12:07:27.727 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.707+0000 7f5fe77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:27.727 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.707+0000 7f5fe77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:27.727 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.707+0000 7f60067fc640 1 --2- 10.20.193.77:0/3766822121 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5fd403a170 0x7f5fd403c630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0007fd0 tx=0x7f5ff0007ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:27.818 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.811+0000 7f600d6d1640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-17T12:07:27.818 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.811+0000 7f600d6d1640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-17T12:07:27.818 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.811+0000 7f600d6d1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:27.818 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.811+0000 7f600d6d1640 1 -- 10.20.193.77:0/3766822121 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f600813aa70 con 0x7f600809c8c0 2026-02-17T12:07:27.818 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f5fe77fe640 1 -- 10.20.193.77:0/3766822121 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1556 (secure 0 0 0) 0x7f5ffc0aaa50 con 0x7f600809c8c0 2026-02-17T12:07:27.818 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f5fe77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-17T12:07:27.818 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f5fe77fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:27.819 INFO:teuthology.orchestra.run.trial077.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"093d53f2-7cd0-4506-a27d-4c950e190615","modified":"2026-02-17T12:04:22.035180Z","created":"2026-02-17T12:04:22.035180Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:3300","nonce":0},{"type":"v1","addr":"10.20.193.77:6789","nonce":0}]},"addr":"10.20.193.77:6789/0","public_addr":"10.20.193.77:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:3300","nonce":0},{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:3301","nonce":0},{"type":"v1","addr":"10.20.193.77:6790","nonce":0}]},"addr":"10.20.193.77:6790/0","public_addr":"10.20.193.77:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:07:27.819 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f600d6d1640 1 -- 10.20.193.77:0/3766822121 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5fd403a170 msgr2=0x7f5fd403c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:27.819 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f600d6d1640 1 --2- 10.20.193.77:0/3766822121 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5fd403a170 0x7f5fd403c630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0007fd0 tx=0x7f5ff0007ac0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.819 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f600d6d1640 10 monclient: shutdown 2026-02-17T12:07:27.819 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f600d6d1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:27.819 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f600d6d1640 1 -- 10.20.193.77:0/3766822121 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 msgr2=0x7f60081374e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:27.819 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f600d6d1640 1 --2- 10.20.193.77:0/3766822121 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 0x7f60081374e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009970 tx=0x7f5ffc0192b0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.819 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f600d6d1640 1 -- 10.20.193.77:0/3766822121 shutdown_connections 2026-02-17T12:07:27.819 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f600d6d1640 1 --2- 10.20.193.77:0/3766822121 >> v2:10.20.193.119:6800/4127986552 conn(0x7f5fd403a170 0x7f5fd403c630 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.819 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f600d6d1640 1 --2- 10.20.193.77:0/3766822121 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f600809faa0 0x7f600806fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.819 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f600d6d1640 1 --2- 10.20.193.77:0/3766822121 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f600809d560 0x7f600806f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.819 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f600d6d1640 1 --2- 10.20.193.77:0/3766822121 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f600809c8c0 0x7f60081374e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.820 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f600d6d1640 1 -- 10.20.193.77:0/3766822121 >> 10.20.193.77:0/3766822121 conn(0x7f60080a3700 msgr2=0x7f6008139ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:27.820 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f600d6d1640 1 -- 10.20.193.77:0/3766822121 shutdown_connections 2026-02-17T12:07:27.820 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.815+0000 7f600d6d1640 1 -- 10.20.193.77:0/3766822121 wait complete. 2026-02-17T12:07:27.829 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-17T12:07:27.829 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T12:07:27.845 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T12:07:27.846 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:07:27.919 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 10 monclient: get_monmap_and_config 2026-02-17T12:07:27.919 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 10 monclient: build_initial_monmap 2026-02-17T12:07:27.919 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 10 monclient: monmap: 2026-02-17T12:07:27.919 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:27.919 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:27.919 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:27.915693+0000 2026-02-17T12:07:27.919 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:27.915693+0000 2026-02-17T12:07:27.920 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:27.920 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:27.920 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:27.920 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:27.920 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:27.920 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:27.920 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:27.920 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:27.920 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 1 Processor -- start 2026-02-17T12:07:27.920 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 1 -- start start 2026-02-17T12:07:27.920 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 10 monclient: init 2026-02-17T12:07:27.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:27.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 10 monclient: _add_conns ranks=[2,4,3,1,0] 2026-02-17T12:07:27.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f169409be20 0x7f1694134e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:27.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 10 monclient(hunting): picked mon.noname-b con 0x7f169409be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:27.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f16940a4c20 0x7f16941380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:27.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 10 monclient(hunting): picked mon.noname-c con 0x7f16940a4c20 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:27.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f16940a5040 0x7f1694138630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:27.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 10 monclient(hunting): picked mon.noname-a con 0x7f16940a5040 addr v2:10.20.193.77:3300/0 2026-02-17T12:07:27.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:27.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f169409c200 con 0x7f16940a5040 2026-02-17T12:07:27.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:27.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f169409cdf0 con 0x7f16940a4c20 2026-02-17T12:07:27.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:27.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f169409d0d0 con 0x7f169409be20 2026-02-17T12:07:27.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:27.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f169a024640 10 monclient(hunting): authenticate will time out at 699.591119s 2026-02-17T12:07:27.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f169409be20 0x7f1694134e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:27.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f1693fff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f16940a5040 0x7f1694138630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:27.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f169409be20 0x7f1694134e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:56198/0 (socket says 10.20.193.77:56198) 2026-02-17T12:07:27.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 1 -- 10.20.193.77:0/138181043 learned_addr learned my addr 10.20.193.77:0/138181043 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:27.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 10 monclient(hunting): get_auth_request con 0x7f169409be20 auth_method 0 2026-02-17T12:07:27.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:27.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:27.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:27.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f1693fff640 10 monclient(hunting): get_auth_request con 0x7f16940a5040 auth_method 0 2026-02-17T12:07:27.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f1693fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:27.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f1693fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:27.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f1693fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:27.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:27.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:27.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:27.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f1693fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:27.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f1693fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:27.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f1692ffd640 1 --2- 10.20.193.77:0/138181043 >> v2:10.20.193.119:3300/0 conn(0x7f16940a4c20 0x7f16941380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:27.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f1693fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:27.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f1692ffd640 10 monclient(hunting): get_auth_request con 0x7f16940a4c20 auth_method 0 2026-02-17T12:07:27.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f1692ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:27.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f1692ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:27.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f1692ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:27.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 10 monclient(hunting): handle_auth_done global_id 4436 payload 274 2026-02-17T12:07:27.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 1 -- 10.20.193.77:0/138181043 >> v2:10.20.193.119:3300/0 conn(0x7f16940a4c20 msgr2=0x7f16941380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:27.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 1 --2- 10.20.193.77:0/138181043 >> v2:10.20.193.119:3300/0 conn(0x7f16940a4c20 0x7f16941380f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 1 -- 10.20.193.77:0/138181043 >> v2:10.20.193.77:3300/0 conn(0x7f16940a5040 msgr2=0x7f1694138630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:27.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 1 --2- 10.20.193.77:0/138181043 >> v2:10.20.193.77:3300/0 conn(0x7f16940a5040 0x7f1694138630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 10 monclient: _finish_hunting 0 2026-02-17T12:07:27.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 1 monclient: found mon.noname-b 2026-02-17T12:07:27.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:27.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:07:27.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.911+0000 7f16937fe640 1 -- 10.20.193.77:0/138181043 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169409d3b0 con 0x7f169409be20 2026-02-17T12:07:27.931 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16937fe640 1 -- 10.20.193.77:0/138181043 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f169409be20 msgr2=0x7f1694134e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:27.931 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16937fe640 1 --2- 10.20.193.77:0/138181043 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f169409be20 0x7f1694134e20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f16940abc20 tx=0x7f168001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5065fdd8ee62c4cb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:27.931 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16927fc640 1 -- 10.20.193.77:0/138181043 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16800b1070 con 0x7f169409be20 2026-02-17T12:07:27.931 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:27.931 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16927fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:27.932 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16927fc640 10 monclient: dump: 2026-02-17T12:07:27.932 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:27.932 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:27.932 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.932 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.932 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:27.932 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:27.932 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:27.932 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:27.932 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:27.932 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:27.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16927fc640 10 monclient: _finish_auth 0 2026-02-17T12:07:27.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16927fc640 10 monclient: _check_auth_tickets 2026-02-17T12:07:27.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:27.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16927fc640 1 -- 10.20.193.77:0/138181043 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1680004230 con 0x7f169409be20 2026-02-17T12:07:27.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 5 monclient: authenticate success, global_id 4436 2026-02-17T12:07:27.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:27.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16927fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:27.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16927fc640 1 -- 10.20.193.77:0/138181043 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16800a8050 con 0x7f169409be20 2026-02-17T12:07:27.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:27.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:27.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f16927fc640 10 monclient: dump: 2026-02-17T12:07:27.933 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:27.934 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:27.934 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.934 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.934 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:27.934 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:27.934 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:27.934 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:27.934 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:27.934 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:27.934 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:27.934 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 4 set_mon_vals no callback set 2026-02-17T12:07:27.934 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 10 monclient: shutdown 2026-02-17T12:07:27.935 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:27.935 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 1 -- 10.20.193.77:0/138181043 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f169409be20 msgr2=0x7f1694134e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:27.935 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 1 --2- 10.20.193.77:0/138181043 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f169409be20 0x7f1694134e20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f16940abc20 tx=0x7f168001c500 comp rx=0 tx=0).stop 2026-02-17T12:07:27.935 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 1 -- 10.20.193.77:0/138181043 shutdown_connections 2026-02-17T12:07:27.935 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 1 --2- 10.20.193.77:0/138181043 >> v2:10.20.193.77:3300/0 conn(0x7f16940a5040 0x7f1694138630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.935 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 1 --2- 10.20.193.77:0/138181043 >> v2:10.20.193.119:3300/0 conn(0x7f16940a4c20 0x7f16941380f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.935 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 1 --2- 10.20.193.77:0/138181043 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f169409be20 0x7f1694134e20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.935 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 1 -- 10.20.193.77:0/138181043 >> 10.20.193.77:0/138181043 conn(0x7f1694074ba0 msgr2=0x7f16940aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:27.935 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 1 -- 10.20.193.77:0/138181043 shutdown_connections 2026-02-17T12:07:27.935 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.915+0000 7f169a024640 1 -- 10.20.193.77:0/138181043 wait complete. 2026-02-17T12:07:27.935 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient: build_initial_monmap 2026-02-17T12:07:27.935 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient: monmap: 2026-02-17T12:07:27.936 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:27.936 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:27.936 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:27.936 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:27.936 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:27.936 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:27.936 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:27.936 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:27.936 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:27.936 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:27.936 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 1 Processor -- start 2026-02-17T12:07:27.936 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 1 -- start start 2026-02-17T12:07:27.937 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient: init 2026-02-17T12:07:27.937 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:27.937 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:07:27.937 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f169409be20 0x7f16940a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:27.937 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient(hunting): picked mon.noname-b con 0x7f169409be20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:27.937 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f16940a4c20 0x7f16940a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:27.937 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient(hunting): picked mon.noname-c con 0x7f16940a4c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:27.937 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f16940a5040 0x7f169413c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:27.937 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient(hunting): picked mon.noname-a con 0x7f16940a5040 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:27.937 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:27.937 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1694138f80 con 0x7f16940a5040 2026-02-17T12:07:27.937 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:27.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1694141eb0 con 0x7f169409be20 2026-02-17T12:07:27.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:27.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f16940ab160 con 0x7f16940a4c20 2026-02-17T12:07:27.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:27.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient(hunting): authenticate will time out at 699.596458s 2026-02-17T12:07:27.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f16940a4c20 0x7f16940a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:27.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f16940a4c20 0x7f16940a45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:56210/0 (socket says 10.20.193.77:56210) 2026-02-17T12:07:27.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 1 -- 10.20.193.77:0/2325941352 learned_addr learned my addr 10.20.193.77:0/2325941352 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:27.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 10 monclient(hunting): get_auth_request con 0x7f16940a4c20 auth_method 0 2026-02-17T12:07:27.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:27.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:27.938 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:27.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1693fff640 1 --2- 10.20.193.77:0/2325941352 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f16940a5040 0x7f169413c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:27.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:27.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:27.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:27.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1693fff640 10 monclient(hunting): get_auth_request con 0x7f16940a5040 auth_method 0 2026-02-17T12:07:27.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1693fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:27.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1693fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:27.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1693fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:27.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1693fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:27.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1693fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:27.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1693fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:27.939 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f16937fe640 1 --2- 10.20.193.77:0/2325941352 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f169409be20 0x7f16940a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:27.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 10 monclient(hunting): handle_auth_done global_id 4439 payload 824 2026-02-17T12:07:27.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 1 -- 10.20.193.77:0/2325941352 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f169409be20 msgr2=0x7f16940a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:27.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 1 --2- 10.20.193.77:0/2325941352 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f169409be20 0x7f16940a4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 1 -- 10.20.193.77:0/2325941352 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f16940a5040 msgr2=0x7f169413c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:27.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 1 --2- 10.20.193.77:0/2325941352 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f16940a5040 0x7f169413c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:27.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:27.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 1 monclient: found mon.noname-c 2026-02-17T12:07:27.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:27.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:27.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 1 -- 10.20.193.77:0/2325941352 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169409e840 con 0x7f16940a4c20 2026-02-17T12:07:27.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 1 -- 10.20.193.77:0/2325941352 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f16940a4c20 msgr2=0x7f16940a45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:27.940 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1692ffd640 1 --2- 10.20.193.77:0/2325941352 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f16940a4c20 0x7f16940a45d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f168400e7c0 tx=0x7f168400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:27.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 1 -- 10.20.193.77:0/2325941352 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1684017070 con 0x7f16940a4c20 2026-02-17T12:07:27.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:27.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:27.941 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 10 monclient: dump: 2026-02-17T12:07:27.941 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:27.941 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:27.941 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.941 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.941 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:27.941 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:27.941 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:27.941 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:27.941 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:27.942 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:27.942 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 10 monclient: _finish_auth 0 2026-02-17T12:07:27.942 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:07:27.942 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:27.942 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 1 -- 10.20.193.77:0/2325941352 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168400cae0 con 0x7f16940a4c20 2026-02-17T12:07:27.942 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:27.942 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 1 -- 10.20.193.77:0/2325941352 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168400f040 con 0x7f16940a4c20 2026-02-17T12:07:27.942 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:27.942 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:27.942 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 10 monclient: dump: 2026-02-17T12:07:27.942 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:27.942 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:27.942 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.943 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:27.943 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:27.943 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:27.943 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:27.943 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:27.943 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:27.943 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:27.943 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 5 monclient: authenticate success, global_id 4439 2026-02-17T12:07:27.943 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f1691ffb640 4 set_mon_vals no callback set 2026-02-17T12:07:27.943 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient: _renew_subs 2026-02-17T12:07:27.943 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:27.943 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 1 -- 10.20.193.77:0/2325941352 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169413e560 con 0x7f16940a4c20 2026-02-17T12:07:27.944 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient: _renew_subs 2026-02-17T12:07:27.944 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:27.944 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 1 -- 10.20.193.77:0/2325941352 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f169406f590 con 0x7f16940a4c20 2026-02-17T12:07:27.944 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:27.944 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:27.944 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:27.944 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f169a024640 1 -- 10.20.193.77:0/2325941352 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16940aac10 con 0x7f16940a4c20 2026-02-17T12:07:27.944 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 1 -- 10.20.193.77:0/2325941352 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f1684012050 con 0x7f16940a4c20 2026-02-17T12:07:27.944 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.919+0000 7f166ffff640 1 --2- 10.20.193.77:0/2325941352 >> v2:10.20.193.119:6800/4127986552 conn(0x7f166403a170 0x7f166403c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:27.944 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.923+0000 7f166ffff640 1 -- 10.20.193.77:0/2325941352 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f168404d720 con 0x7f16940a4c20 2026-02-17T12:07:27.944 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.923+0000 7f16937fe640 1 --2- 10.20.193.77:0/2325941352 >> v2:10.20.193.119:6800/4127986552 conn(0x7f166403a170 0x7f166403c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:27.944 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.923+0000 7f16937fe640 10 monclient: get_auth_request con 0x7f166403a170 auth_method 0 2026-02-17T12:07:27.945 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.923+0000 7f166ffff640 1 -- 10.20.193.77:0/2325941352 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f1684013410 con 0x7f16940a4c20 2026-02-17T12:07:27.945 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.923+0000 7f166ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:27.945 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.923+0000 7f166ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:27.945 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.923+0000 7f16937fe640 1 --2- 10.20.193.77:0/2325941352 >> v2:10.20.193.119:6800/4127986552 conn(0x7f166403a170 0x7f166403c630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16940a7cb0 tx=0x7f16800a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:28.002 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.995+0000 7f169a024640 1 -- 10.20.193.77:0/2325941352 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1694134e00 con 0x7f166403a170 2026-02-17T12:07:28.003 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f166ffff640 1 -- 10.20.193.77:0/2325941352 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33975 (secure 0 0 0) 0x7f1694134e00 con 0x7f166403a170 2026-02-17T12:07:28.004 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:07:28.005 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T12:07:28.005 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f169a024640 1 -- 10.20.193.77:0/2325941352 >> v2:10.20.193.119:6800/4127986552 conn(0x7f166403a170 msgr2=0x7f166403c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.005 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f169a024640 1 --2- 10.20.193.77:0/2325941352 >> v2:10.20.193.119:6800/4127986552 conn(0x7f166403a170 0x7f166403c630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16940a7cb0 tx=0x7f16800a7000 comp rx=0 tx=0).stop 2026-02-17T12:07:28.005 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f169a024640 10 monclient: shutdown 2026-02-17T12:07:28.005 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f169a024640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:28.005 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f169a024640 1 -- 10.20.193.77:0/2325941352 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f16940a4c20 msgr2=0x7f16940a45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f169a024640 1 --2- 10.20.193.77:0/2325941352 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f16940a4c20 0x7f16940a45d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f168400e7c0 tx=0x7f168400ec80 comp rx=0 tx=0).stop 2026-02-17T12:07:28.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f169a024640 1 -- 10.20.193.77:0/2325941352 shutdown_connections 2026-02-17T12:07:28.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f169a024640 1 --2- 10.20.193.77:0/2325941352 >> v2:10.20.193.119:6800/4127986552 conn(0x7f166403a170 0x7f166403c630 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f169a024640 1 --2- 10.20.193.77:0/2325941352 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f16940a5040 0x7f169413c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f169a024640 1 --2- 10.20.193.77:0/2325941352 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f16940a4c20 0x7f16940a45d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f169a024640 1 --2- 10.20.193.77:0/2325941352 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f169409be20 0x7f16940a4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f169a024640 1 -- 10.20.193.77:0/2325941352 >> 10.20.193.77:0/2325941352 conn(0x7f1694074ba0 msgr2=0x7f1694132a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:28.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f169a024640 1 -- 10.20.193.77:0/2325941352 shutdown_connections 2026-02-17T12:07:28.006 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:27.999+0000 7f169a024640 1 -- 10.20.193.77:0/2325941352 wait complete. 2026-02-17T12:07:28.013 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2026-02-17T12:07:26.280547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":184196,"kb_used_data":1600,"kb_used_omap":9,"kb_used_meta":182454,"kb_avail":566046844,"statfs":{"total":579820584960,"available":579631968256,"internally_reserved":0,"allocated":1638400,"data_stored":1609924,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":186833575},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000962"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567297+0000","last_change":"2026-02-17T12:05:14.474034+0000","last_active":"2026-02-17T12:05:50.567297+0000","last_peered":"2026-02-17T12:05:50.567297+0000","last_clean":"2026-02-17T12:05:50.567297+0000","last_became_active":"2026-02-17T12:05:12.276658+0000","last_became_peered":"2026-02-17T12:05:12.276658+0000","last_unstale":"2026-02-17T12:05:50.567297+0000","last_undegraded":"2026-02-17T12:05:50.567297+0000","last_fullsized":"2026-02-17T12:05:50.567297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:42:47.843930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048223100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.554640+0000","last_change":"2026-02-17T12:05:14.478866+0000","last_active":"2026-02-17T12:05:51.554640+0000","last_peered":"2026-02-17T12:05:51.554640+0000","last_clean":"2026-02-17T12:05:51.554640+0000","last_became_active":"2026-02-17T12:05:12.278326+0000","last_became_peered":"2026-02-17T12:05:12.278326+0000","last_unstale":"2026-02-17T12:05:51.554640+0000","last_undegraded":"2026-02-17T12:05:51.554640+0000","last_fullsized":"2026-02-17T12:05:51.554640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:40:28.089270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031809399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567244+0000","last_change":"2026-02-17T12:05:14.473914+0000","last_active":"2026-02-17T12:05:50.567244+0000","last_peered":"2026-02-17T12:05:50.567244+0000","last_clean":"2026-02-17T12:05:50.567244+0000","last_became_active":"2026-02-17T12:05:12.528026+0000","last_became_peered":"2026-02-17T12:05:12.528026+0000","last_unstale":"2026-02-17T12:05:50.567244+0000","last_undegraded":"2026-02-17T12:05:50.567244+0000","last_fullsized":"2026-02-17T12:05:50.567244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:38:50.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039251500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.554649+0000","last_change":"2026-02-17T12:05:14.478884+0000","last_active":"2026-02-17T12:05:51.554649+0000","last_peered":"2026-02-17T12:05:51.554649+0000","last_clean":"2026-02-17T12:05:51.554649+0000","last_became_active":"2026-02-17T12:05:12.529966+0000","last_became_peered":"2026-02-17T12:05:12.529966+0000","last_unstale":"2026-02-17T12:05:51.554649+0000","last_undegraded":"2026-02-17T12:05:51.554649+0000","last_fullsized":"2026-02-17T12:05:51.554649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:18:45.016861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033970499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.553272+0000","last_change":"2026-02-17T12:05:14.475335+0000","last_active":"2026-02-17T12:05:51.553272+0000","last_peered":"2026-02-17T12:05:51.553272+0000","last_clean":"2026-02-17T12:05:51.553272+0000","last_became_active":"2026-02-17T12:05:12.276436+0000","last_became_peered":"2026-02-17T12:05:12.276436+0000","last_unstale":"2026-02-17T12:05:51.553272+0000","last_undegraded":"2026-02-17T12:05:51.553272+0000","last_fullsized":"2026-02-17T12:05:51.553272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:54:19.820473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054557800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.554560+0000","last_change":"2026-02-17T12:05:14.742903+0000","last_active":"2026-02-17T12:05:51.554560+0000","last_peered":"2026-02-17T12:05:51.554560+0000","last_clean":"2026-02-17T12:05:51.554560+0000","last_became_active":"2026-02-17T12:05:12.278426+0000","last_became_peered":"2026-02-17T12:05:12.278426+0000","last_unstale":"2026-02-17T12:05:51.554560+0000","last_undegraded":"2026-02-17T12:05:51.554560+0000","last_fullsized":"2026-02-17T12:05:51.554560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:36:27.118344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032063000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567254+0000","last_change":"2026-02-17T12:05:14.473834+0000","last_active":"2026-02-17T12:05:50.567254+0000","last_peered":"2026-02-17T12:05:50.567254+0000","last_clean":"2026-02-17T12:05:50.567254+0000","last_became_active":"2026-02-17T12:05:12.276579+0000","last_became_peered":"2026-02-17T12:05:12.276579+0000","last_unstale":"2026-02-17T12:05:50.567254+0000","last_undegraded":"2026-02-17T12:05:50.567254+0000","last_fullsized":"2026-02-17T12:05:50.567254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:36:50.953203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311976,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.553311+0000","last_change":"2026-02-17T12:05:14.475054+0000","last_active":"2026-02-17T12:05:51.553311+0000","last_peered":"2026-02-17T12:05:51.553311+0000","last_clean":"2026-02-17T12:05:51.553311+0000","last_became_active":"2026-02-17T12:05:12.276141+0000","last_became_peered":"2026-02-17T12:05:12.276141+0000","last_unstale":"2026-02-17T12:05:51.553311+0000","last_undegraded":"2026-02-17T12:05:51.553311+0000","last_fullsized":"2026-02-17T12:05:51.553311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:51:25.694043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025524199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'112","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567297+0000","last_change":"2026-02-17T12:05:08.039772+0000","last_active":"2026-02-17T12:05:50.567297+0000","last_peered":"2026-02-17T12:05:50.567297+0000","last_clean":"2026-02-17T12:05:50.567297+0000","last_became_active":"2026-02-17T12:05:08.039610+0000","last_became_peered":"2026-02-17T12:05:08.039610+0000","last_unstale":"2026-02-17T12:05:50.567297+0000","last_undegraded":"2026-02-17T12:05:50.567297+0000","last_fullsized":"2026-02-17T12:05:50.567297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_clean_scrub_stamp":"2026-02-17T12:05:06.954552+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:26:36.107316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":258048,"data_stored":92024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607582,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":253952,"data_stored":92005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607582,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":307200,"data_stored":620933,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607582,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":253952,"data_stored":92005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607582,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":258048,"data_stored":92024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640287,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":307200,"data_stored":620933,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:07:28.015 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:07:28.084 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 10 monclient: get_monmap_and_config 2026-02-17T12:07:28.084 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 10 monclient: build_initial_monmap 2026-02-17T12:07:28.084 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 10 monclient: monmap: 2026-02-17T12:07:28.084 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:28.084 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.084 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:28.083308+0000 2026-02-17T12:07:28.084 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:28.083308+0000 2026-02-17T12:07:28.084 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:28.084 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.084 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:28.085 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:28.085 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:28.085 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:28.085 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:28.085 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.085 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 1 Processor -- start 2026-02-17T12:07:28.085 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 1 -- start start 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 10 monclient: init 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f36a809be20 0x7f36a8134e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 10 monclient(hunting): picked mon.noname-b con 0x7f36a809be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f36a80a4c20 addr v1:10.20.193.77:6789/0 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f36a80a5040 addr v1:10.20.193.119:6789/0 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36a8138f10 con 0x7f36a80a4c20 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36a809cdf0 con 0x7f36a80a5040 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f36a809c200 con 0x7f36a809be20 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36afedf640 10 monclient(hunting): authenticate will time out at 699.758724s 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f36a809be20 0x7f36a8134e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36ad453640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f36a80a4c20 0x7f36a81380f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:50506/0 (socket says 10.20.193.77:50506) 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36ad453640 1 -- 10.20.193.77:0/2019946617 learned_addr learned my addr 10.20.193.77:0/2019946617 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 10 monclient(hunting): get_auth_request con 0x7f36a809be20 auth_method 0 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 10 monclient(hunting): handle_auth_done global_id 4442 payload 274 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 1 -- 10.20.193.77:0/2019946617 >> v1:10.20.193.119:6789/0 conn(0x7f36a80a5040 legacy=0x7f36a8138800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 1 -- 10.20.193.77:0/2019946617 >> v1:10.20.193.77:6789/0 conn(0x7f36a80a4c20 legacy=0x7f36a81380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 10 monclient: _finish_hunting 0 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 1 monclient: found mon.noname-b 2026-02-17T12:07:28.086 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:28.087 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:07:28.087 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.079+0000 7f36adc54640 1 -- 10.20.193.77:0/2019946617 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a809d0d0 con 0x7f36a809be20 2026-02-17T12:07:28.088 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36adc54640 1 -- 10.20.193.77:0/2019946617 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f36a809be20 msgr2=0x7f36a8134e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:28.088 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36adc54640 1 --2- 10.20.193.77:0/2019946617 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f36a809be20 0x7f36a8134e20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f36980098f0 tx=0x7f369801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=470e3003ccacfafe server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36acc52640 1 -- 10.20.193.77:0/2019946617 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36980b0070 con 0x7f36a809be20 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36acc52640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36acc52640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36acc52640 10 monclient: dump: 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36acc52640 10 monclient: _finish_auth 0 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36acc52640 10 monclient: _check_auth_tickets 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36acc52640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36acc52640 1 -- 10.20.193.77:0/2019946617 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36980ab600 con 0x7f36a809be20 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36acc52640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:28.089 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36acc52640 1 -- 10.20.193.77:0/2019946617 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36980ab9d0 con 0x7f36a809be20 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36acc52640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36acc52640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36acc52640 10 monclient: dump: 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 5 monclient: authenticate success, global_id 4442 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:28.090 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 4 set_mon_vals no callback set 2026-02-17T12:07:28.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 10 monclient: shutdown 2026-02-17T12:07:28.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:28.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 1 -- 10.20.193.77:0/2019946617 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f36a809be20 msgr2=0x7f36a8134e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 1 --2- 10.20.193.77:0/2019946617 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f36a809be20 0x7f36a8134e20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f36980098f0 tx=0x7f369801c4c0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 1 -- 10.20.193.77:0/2019946617 shutdown_connections 2026-02-17T12:07:28.091 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 1 --2- 10.20.193.77:0/2019946617 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f36a809be20 0x7f36a8134e20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 1 -- 10.20.193.77:0/2019946617 >> 10.20.193.77:0/2019946617 conn(0x7f36a8074ba0 msgr2=0x7f36a80aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 1 -- 10.20.193.77:0/2019946617 shutdown_connections 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 1 -- 10.20.193.77:0/2019946617 wait complete. 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 10 monclient: build_initial_monmap 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 10 monclient: monmap: 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 1 Processor -- start 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 1 -- start start 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 10 monclient: init 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f36a809be20 0x7f36a81d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 10 monclient(hunting): picked mon.noname-a con 0x7f36a809be20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.083+0000 7f36afedf640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f36a80a4c20 0x7f36a8140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 10 monclient(hunting): picked mon.noname-b con 0x7f36a80a4c20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f36a80a5040 0x7f36a80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 10 monclient(hunting): picked mon.noname-c con 0x7f36a80a5040 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f36a8143ed0 con 0x7f36a809be20 2026-02-17T12:07:28.092 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f36a8144050 con 0x7f36a80a4c20 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f36a81441d0 con 0x7f36a80a5040 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 10 monclient(hunting): authenticate will time out at 699.764021s 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36adc54640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f36a809be20 0x7f36a81d22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f36a80a5040 0x7f36a80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36adc54640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f36a809be20 0x7f36a81d22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:55052/0 (socket says 10.20.193.77:55052) 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36adc54640 1 -- 10.20.193.77:0/3288816828 learned_addr learned my addr 10.20.193.77:0/3288816828 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36adc54640 10 monclient(hunting): get_auth_request con 0x7f36a809be20 auth_method 0 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36adc54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36adc54640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36adc54640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 10 monclient(hunting): get_auth_request con 0x7f36a80a5040 auth_method 0 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36adc54640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36adc54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36adc54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ad453640 1 --2- 10.20.193.77:0/3288816828 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f36a80a4c20 0x7f36a8140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ad453640 10 monclient(hunting): get_auth_request con 0x7f36a80a4c20 auth_method 0 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ad453640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ad453640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ad453640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 10 monclient(hunting): handle_auth_done global_id 4445 payload 824 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 1 -- 10.20.193.77:0/3288816828 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f36a80a4c20 msgr2=0x7f36a8140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.093 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 1 --2- 10.20.193.77:0/3288816828 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f36a80a4c20 0x7f36a8140880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.094 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 1 -- 10.20.193.77:0/3288816828 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f36a809be20 msgr2=0x7f36a81d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.094 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 1 --2- 10.20.193.77:0/3288816828 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f36a809be20 0x7f36a81d22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.094 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 10 monclient: _finish_hunting 0 2026-02-17T12:07:28.094 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 1 monclient: found mon.noname-c 2026-02-17T12:07:28.094 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:28.094 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:28.094 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 1 -- 10.20.193.77:0/3288816828 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a806f590 con 0x7f36a80a5040 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 1 -- 10.20.193.77:0/3288816828 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f36a80a5040 msgr2=0x7f36a80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36ae455640 1 --2- 10.20.193.77:0/3288816828 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f36a80a5040 0x7f36a80a2b90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f36a400cb10 tx=0x7f36a400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 1 -- 10.20.193.77:0/3288816828 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4016020 con 0x7f36a80a5040 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 10 monclient: dump: 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 10 monclient: _finish_auth 0 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 10 monclient: _check_auth_tickets 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 1 -- 10.20.193.77:0/3288816828 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a4012420 con 0x7f36a80a5040 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 1 -- 10.20.193.77:0/3288816828 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4012810 con 0x7f36a80a5040 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 10 monclient: dump: 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.095 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f3697fff640 4 set_mon_vals no callback set 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 5 monclient: authenticate success, global_id 4445 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 10 monclient: _renew_subs 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 1 -- 10.20.193.77:0/3288816828 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a813ae00 con 0x7f36a80a5040 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 10 monclient: _renew_subs 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 1 -- 10.20.193.77:0/3288816828 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a81d2aa0 con 0x7f36a80a5040 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36afedf640 1 -- 10.20.193.77:0/3288816828 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a8134e00 con 0x7f36a80a5040 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 1 -- 10.20.193.77:0/3288816828 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f36a4012a30 con 0x7f36a80a5040 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 1 --2- 10.20.193.77:0/3288816828 >> v2:10.20.193.119:6800/4127986552 conn(0x7f367803a170 0x7f367803c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36967fc640 1 -- 10.20.193.77:0/3288816828 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f36a404e240 con 0x7f36a80a5040 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36adc54640 1 --2- 10.20.193.77:0/3288816828 >> v2:10.20.193.119:6800/4127986552 conn(0x7f367803a170 0x7f367803c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.087+0000 7f36adc54640 10 monclient: get_auth_request con 0x7f367803a170 auth_method 0 2026-02-17T12:07:28.096 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.091+0000 7f36adc54640 1 --2- 10.20.193.77:0/3288816828 >> v2:10.20.193.119:6800/4127986552 conn(0x7f367803a170 0x7f367803c630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f369801cd60 tx=0x7f3698008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:28.097 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.091+0000 7f36967fc640 1 -- 10.20.193.77:0/3288816828 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f36a4020020 con 0x7f36a80a5040 2026-02-17T12:07:28.097 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.091+0000 7f36967fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:28.097 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.091+0000 7f36967fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:28.172 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 1 -- 10.20.193.77:0/3288816828 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36a80a4830 con 0x7f367803a170 2026-02-17T12:07:28.173 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36967fc640 1 -- 10.20.193.77:0/3288816828 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33975 (secure 0 0 0) 0x7f36a80a4830 con 0x7f367803a170 2026-02-17T12:07:28.174 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:07:28.175 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T12:07:28.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 1 -- 10.20.193.77:0/3288816828 >> v2:10.20.193.119:6800/4127986552 conn(0x7f367803a170 msgr2=0x7f367803c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 1 --2- 10.20.193.77:0/3288816828 >> v2:10.20.193.119:6800/4127986552 conn(0x7f367803a170 0x7f367803c630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f369801cd60 tx=0x7f3698008040 comp rx=0 tx=0).stop 2026-02-17T12:07:28.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 10 monclient: shutdown 2026-02-17T12:07:28.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:28.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 1 -- 10.20.193.77:0/3288816828 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f36a80a5040 msgr2=0x7f36a80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 1 --2- 10.20.193.77:0/3288816828 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f36a80a5040 0x7f36a80a2b90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f36a400cb10 tx=0x7f36a400a060 comp rx=0 tx=0).stop 2026-02-17T12:07:28.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 1 -- 10.20.193.77:0/3288816828 shutdown_connections 2026-02-17T12:07:28.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 1 --2- 10.20.193.77:0/3288816828 >> v2:10.20.193.119:6800/4127986552 conn(0x7f367803a170 0x7f367803c630 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 1 --2- 10.20.193.77:0/3288816828 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f36a80a5040 0x7f36a80a2b90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 1 --2- 10.20.193.77:0/3288816828 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f36a80a4c20 0x7f36a8140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 1 --2- 10.20.193.77:0/3288816828 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f36a809be20 0x7f36a81d22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 1 -- 10.20.193.77:0/3288816828 >> 10.20.193.77:0/3288816828 conn(0x7f36a8074ba0 msgr2=0x7f36a8137db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:28.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 1 -- 10.20.193.77:0/3288816828 shutdown_connections 2026-02-17T12:07:28.176 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.167+0000 7f36afedf640 1 -- 10.20.193.77:0/3288816828 wait complete. 2026-02-17T12:07:28.183 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2026-02-17T12:07:26.280547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":184196,"kb_used_data":1600,"kb_used_omap":9,"kb_used_meta":182454,"kb_avail":566046844,"statfs":{"total":579820584960,"available":579631968256,"internally_reserved":0,"allocated":1638400,"data_stored":1609924,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":186833575},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000962"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567297+0000","last_change":"2026-02-17T12:05:14.474034+0000","last_active":"2026-02-17T12:05:50.567297+0000","last_peered":"2026-02-17T12:05:50.567297+0000","last_clean":"2026-02-17T12:05:50.567297+0000","last_became_active":"2026-02-17T12:05:12.276658+0000","last_became_peered":"2026-02-17T12:05:12.276658+0000","last_unstale":"2026-02-17T12:05:50.567297+0000","last_undegraded":"2026-02-17T12:05:50.567297+0000","last_fullsized":"2026-02-17T12:05:50.567297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:42:47.843930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048223100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.554640+0000","last_change":"2026-02-17T12:05:14.478866+0000","last_active":"2026-02-17T12:05:51.554640+0000","last_peered":"2026-02-17T12:05:51.554640+0000","last_clean":"2026-02-17T12:05:51.554640+0000","last_became_active":"2026-02-17T12:05:12.278326+0000","last_became_peered":"2026-02-17T12:05:12.278326+0000","last_unstale":"2026-02-17T12:05:51.554640+0000","last_undegraded":"2026-02-17T12:05:51.554640+0000","last_fullsized":"2026-02-17T12:05:51.554640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:40:28.089270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031809399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567244+0000","last_change":"2026-02-17T12:05:14.473914+0000","last_active":"2026-02-17T12:05:50.567244+0000","last_peered":"2026-02-17T12:05:50.567244+0000","last_clean":"2026-02-17T12:05:50.567244+0000","last_became_active":"2026-02-17T12:05:12.528026+0000","last_became_peered":"2026-02-17T12:05:12.528026+0000","last_unstale":"2026-02-17T12:05:50.567244+0000","last_undegraded":"2026-02-17T12:05:50.567244+0000","last_fullsized":"2026-02-17T12:05:50.567244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:38:50.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039251500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.554649+0000","last_change":"2026-02-17T12:05:14.478884+0000","last_active":"2026-02-17T12:05:51.554649+0000","last_peered":"2026-02-17T12:05:51.554649+0000","last_clean":"2026-02-17T12:05:51.554649+0000","last_became_active":"2026-02-17T12:05:12.529966+0000","last_became_peered":"2026-02-17T12:05:12.529966+0000","last_unstale":"2026-02-17T12:05:51.554649+0000","last_undegraded":"2026-02-17T12:05:51.554649+0000","last_fullsized":"2026-02-17T12:05:51.554649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:18:45.016861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033970499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.553272+0000","last_change":"2026-02-17T12:05:14.475335+0000","last_active":"2026-02-17T12:05:51.553272+0000","last_peered":"2026-02-17T12:05:51.553272+0000","last_clean":"2026-02-17T12:05:51.553272+0000","last_became_active":"2026-02-17T12:05:12.276436+0000","last_became_peered":"2026-02-17T12:05:12.276436+0000","last_unstale":"2026-02-17T12:05:51.553272+0000","last_undegraded":"2026-02-17T12:05:51.553272+0000","last_fullsized":"2026-02-17T12:05:51.553272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:54:19.820473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054557800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.554560+0000","last_change":"2026-02-17T12:05:14.742903+0000","last_active":"2026-02-17T12:05:51.554560+0000","last_peered":"2026-02-17T12:05:51.554560+0000","last_clean":"2026-02-17T12:05:51.554560+0000","last_became_active":"2026-02-17T12:05:12.278426+0000","last_became_peered":"2026-02-17T12:05:12.278426+0000","last_unstale":"2026-02-17T12:05:51.554560+0000","last_undegraded":"2026-02-17T12:05:51.554560+0000","last_fullsized":"2026-02-17T12:05:51.554560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:36:27.118344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032063000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567254+0000","last_change":"2026-02-17T12:05:14.473834+0000","last_active":"2026-02-17T12:05:50.567254+0000","last_peered":"2026-02-17T12:05:50.567254+0000","last_clean":"2026-02-17T12:05:50.567254+0000","last_became_active":"2026-02-17T12:05:12.276579+0000","last_became_peered":"2026-02-17T12:05:12.276579+0000","last_unstale":"2026-02-17T12:05:50.567254+0000","last_undegraded":"2026-02-17T12:05:50.567254+0000","last_fullsized":"2026-02-17T12:05:50.567254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:36:50.953203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311976,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.553311+0000","last_change":"2026-02-17T12:05:14.475054+0000","last_active":"2026-02-17T12:05:51.553311+0000","last_peered":"2026-02-17T12:05:51.553311+0000","last_clean":"2026-02-17T12:05:51.553311+0000","last_became_active":"2026-02-17T12:05:12.276141+0000","last_became_peered":"2026-02-17T12:05:12.276141+0000","last_unstale":"2026-02-17T12:05:51.553311+0000","last_undegraded":"2026-02-17T12:05:51.553311+0000","last_fullsized":"2026-02-17T12:05:51.553311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:51:25.694043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025524199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'112","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567297+0000","last_change":"2026-02-17T12:05:08.039772+0000","last_active":"2026-02-17T12:05:50.567297+0000","last_peered":"2026-02-17T12:05:50.567297+0000","last_clean":"2026-02-17T12:05:50.567297+0000","last_became_active":"2026-02-17T12:05:08.039610+0000","last_became_peered":"2026-02-17T12:05:08.039610+0000","last_unstale":"2026-02-17T12:05:50.567297+0000","last_undegraded":"2026-02-17T12:05:50.567297+0000","last_fullsized":"2026-02-17T12:05:50.567297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_clean_scrub_stamp":"2026-02-17T12:05:06.954552+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:26:36.107316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":258048,"data_stored":92024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607582,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":253952,"data_stored":92005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607582,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":307200,"data_stored":620933,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607582,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":253952,"data_stored":92005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607582,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":258048,"data_stored":92024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640287,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":307200,"data_stored":620933,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:07:28.184 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T12:07:28.184 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:07:28.252 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 10 monclient: get_monmap_and_config 2026-02-17T12:07:28.253 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 10 monclient: build_initial_monmap 2026-02-17T12:07:28.253 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 10 monclient: monmap: 2026-02-17T12:07:28.253 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:28.253 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.253 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:28.250978+0000 2026-02-17T12:07:28.253 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:28.250978+0000 2026-02-17T12:07:28.253 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:28.253 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.253 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:28.253 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:28.253 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:28.254 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:28.254 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:28.254 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.254 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 1 Processor -- start 2026-02-17T12:07:28.254 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 1 -- start start 2026-02-17T12:07:28.254 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 10 monclient: init 2026-02-17T12:07:28.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:28.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 10 monclient: _add_conns ranks=[2,3,4,0,1] 2026-02-17T12:07:28.256 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 0x7f561406da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 10 monclient(hunting): picked mon.noname-b con 0x7f56140a3290 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:28.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f56140a3670 0x7f56140a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 10 monclient(hunting): picked mon.noname-a con 0x7f56140a3670 addr v2:10.20.193.77:3300/0 2026-02-17T12:07:28.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f5614138540 0x7f56141389b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 10 monclient(hunting): picked mon.noname-c con 0x7f5614138540 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:28.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f56140750b0 con 0x7f56140a3670 2026-02-17T12:07:28.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f561406ee50 con 0x7f5614138540 2026-02-17T12:07:28.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.257 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f56140a5090 con 0x7f56140a3290 2026-02-17T12:07:28.258 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:28.258 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f561a8c4640 10 monclient(hunting): authenticate will time out at 699.926523s 2026-02-17T12:07:28.258 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5613fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 0x7f561406da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.258 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f56140a3670 0x7f56140a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.258 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5613fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 0x7f561406da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:56236/0 (socket says 10.20.193.77:56236) 2026-02-17T12:07:28.258 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5613fff640 1 -- 10.20.193.77:0/961338358 learned_addr learned my addr 10.20.193.77:0/961338358 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:28.258 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5613fff640 10 monclient(hunting): get_auth_request con 0x7f56140a3290 auth_method 0 2026-02-17T12:07:28.258 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5613fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.258 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5613fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.258 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5613fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 10 monclient(hunting): get_auth_request con 0x7f56140a3670 auth_method 0 2026-02-17T12:07:28.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5613fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:28.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5613fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:28.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5613fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:28.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:28.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:28.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:28.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5618e3a640 1 --2- 10.20.193.77:0/961338358 >> v2:10.20.193.119:3300/0 conn(0x7f5614138540 0x7f56141389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.259 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5618e3a640 10 monclient(hunting): get_auth_request con 0x7f5614138540 auth_method 0 2026-02-17T12:07:28.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5618e3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5618e3a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5618e3a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 10 monclient(hunting): handle_auth_done global_id 4464 payload 274 2026-02-17T12:07:28.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 1 -- 10.20.193.77:0/961338358 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 msgr2=0x7f561406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:28.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 1 --2- 10.20.193.77:0/961338358 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 0x7f561406da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 1 -- 10.20.193.77:0/961338358 >> v2:10.20.193.119:3300/0 conn(0x7f5614138540 msgr2=0x7f56141389b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:28.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 1 --2- 10.20.193.77:0/961338358 >> v2:10.20.193.119:3300/0 conn(0x7f5614138540 0x7f56141389b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 10 monclient: _finish_hunting 0 2026-02-17T12:07:28.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 1 monclient: found mon.noname-a 2026-02-17T12:07:28.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:28.260 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:28.261 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f56137fe640 1 -- 10.20.193.77:0/961338358 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56140a4e10 con 0x7f56140a3670 2026-02-17T12:07:28.261 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.247+0000 7f5613fff640 1 --2- 10.20.193.77:0/961338358 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 0x7f561406da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:28.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f56137fe640 1 -- 10.20.193.77:0/961338358 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56140a3670 msgr2=0x7f56140a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:28.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f56137fe640 1 --2- 10.20.193.77:0/961338358 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56140a3670 0x7f56140a3a50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f561406e590 tx=0x7f560401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77332ae1a3f0d5f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:28.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f5612ffd640 1 -- 10.20.193.77:0/961338358 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56040b0070 con 0x7f56140a3670 2026-02-17T12:07:28.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f5612ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:28.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f5612ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:28.267 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f5612ffd640 10 monclient: dump: 2026-02-17T12:07:28.267 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:28.268 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.268 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.268 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.268 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:28.268 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.268 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:28.268 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:28.268 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:28.268 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f5612ffd640 10 monclient: _finish_auth 0 2026-02-17T12:07:28.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f5612ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:07:28.268 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f5612ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:28.269 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f5612ffd640 1 -- 10.20.193.77:0/961338358 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56040ab600 con 0x7f56140a3670 2026-02-17T12:07:28.269 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 5 monclient: authenticate success, global_id 4464 2026-02-17T12:07:28.269 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:28.269 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f5612ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:28.269 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f5612ffd640 1 -- 10.20.193.77:0/961338358 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56040ab9d0 con 0x7f56140a3670 2026-02-17T12:07:28.269 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f5612ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:28.269 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f5612ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:28.269 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f5612ffd640 10 monclient: dump: 2026-02-17T12:07:28.269 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:28.269 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.269 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.269 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.270 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:28.270 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.270 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:28.270 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:28.270 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:28.270 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.270 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:28.270 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 4 set_mon_vals no callback set 2026-02-17T12:07:28.270 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 10 monclient: shutdown 2026-02-17T12:07:28.270 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:28.270 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 1 -- 10.20.193.77:0/961338358 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56140a3670 msgr2=0x7f56140a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.270 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 1 --2- 10.20.193.77:0/961338358 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56140a3670 0x7f56140a3a50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f561406e590 tx=0x7f560401c460 comp rx=0 tx=0).stop 2026-02-17T12:07:28.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 1 -- 10.20.193.77:0/961338358 shutdown_connections 2026-02-17T12:07:28.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 1 --2- 10.20.193.77:0/961338358 >> v2:10.20.193.119:3300/0 conn(0x7f5614138540 0x7f56141389b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 1 --2- 10.20.193.77:0/961338358 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56140a3670 0x7f56140a3a50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 1 --2- 10.20.193.77:0/961338358 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 0x7f561406da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 1 -- 10.20.193.77:0/961338358 >> 10.20.193.77:0/961338358 conn(0x7f56140a8890 msgr2=0x7f56140a8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:28.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 1 -- 10.20.193.77:0/961338358 shutdown_connections 2026-02-17T12:07:28.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.251+0000 7f561a8c4640 1 -- 10.20.193.77:0/961338358 wait complete. 2026-02-17T12:07:28.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient: build_initial_monmap 2026-02-17T12:07:28.271 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient: monmap: 2026-02-17T12:07:28.271 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:28.271 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:28.271 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:28.272 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:28.272 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:28.272 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.272 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:28.272 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:28.272 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:28.272 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.272 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 1 Processor -- start 2026-02-17T12:07:28.272 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 1 -- start start 2026-02-17T12:07:28.272 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient: init 2026-02-17T12:07:28.272 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:28.272 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:07:28.272 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 0x7f5614122c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient(hunting): picked mon.noname-c con 0x7f56140a3290 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:28.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56140a3670 0x7f561411eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient(hunting): picked mon.noname-a con 0x7f56140a3670 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:28.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5614138540 0x7f561411f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient(hunting): picked mon.noname-b con 0x7f5614138540 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:28.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f561406fa30 con 0x7f56140a3670 2026-02-17T12:07:28.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f561406f8b0 con 0x7f5614138540 2026-02-17T12:07:28.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5614141fb0 con 0x7f56140a3290 2026-02-17T12:07:28.273 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:28.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient(hunting): authenticate will time out at 699.932576s 2026-02-17T12:07:28.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 0x7f5614122c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f56137fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56140a3670 0x7f561411eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 0x7f5614122c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:56250/0 (socket says 10.20.193.77:56250) 2026-02-17T12:07:28.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 1 -- 10.20.193.77:0/2628141076 learned_addr learned my addr 10.20.193.77:0/2628141076 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:28.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 10 monclient(hunting): get_auth_request con 0x7f56140a3290 auth_method 0 2026-02-17T12:07:28.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f56137fe640 10 monclient(hunting): get_auth_request con 0x7f56140a3670 auth_method 0 2026-02-17T12:07:28.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f56137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.274 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f56137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f56137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:28.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:28.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:28.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f56137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:28.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f56137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:28.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f56137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:28.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5618e3a640 1 --2- 10.20.193.77:0/2628141076 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5614138540 0x7f561411f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5618e3a640 10 monclient(hunting): get_auth_request con 0x7f5614138540 auth_method 0 2026-02-17T12:07:28.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5618e3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5618e3a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5618e3a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.275 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 10 monclient(hunting): handle_auth_done global_id 4451 payload 824 2026-02-17T12:07:28.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 1 -- 10.20.193.77:0/2628141076 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5614138540 msgr2=0x7f561411f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 1 --2- 10.20.193.77:0/2628141076 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5614138540 0x7f561411f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 1 -- 10.20.193.77:0/2628141076 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56140a3670 msgr2=0x7f561411eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 1 --2- 10.20.193.77:0/2628141076 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56140a3670 0x7f561411eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 10 monclient: _finish_hunting 0 2026-02-17T12:07:28.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 1 monclient: found mon.noname-c 2026-02-17T12:07:28.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:28.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:28.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 1 -- 10.20.193.77:0/2628141076 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5614120a00 con 0x7f56140a3290 2026-02-17T12:07:28.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 1 -- 10.20.193.77:0/2628141076 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 msgr2=0x7f5614122c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:28.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5613fff640 1 --2- 10.20.193.77:0/2628141076 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 0x7f5614122c70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f560000ec10 tx=0x7f560000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:28.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5610ff9640 1 -- 10.20.193.77:0/2628141076 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5600017070 con 0x7f56140a3290 2026-02-17T12:07:28.276 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5610ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:28.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5610ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:28.277 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5610ff9640 10 monclient: dump: 2026-02-17T12:07:28.277 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:28.277 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.277 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.277 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.277 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:28.277 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.277 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:28.277 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:28.277 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:28.277 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5610ff9640 10 monclient: _finish_auth 0 2026-02-17T12:07:28.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5610ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:07:28.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5610ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:28.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5610ff9640 1 -- 10.20.193.77:0/2628141076 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560000ce40 con 0x7f56140a3290 2026-02-17T12:07:28.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5610ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:28.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5610ff9640 1 -- 10.20.193.77:0/2628141076 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5600013690 con 0x7f56140a3290 2026-02-17T12:07:28.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5610ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:28.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5610ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:28.278 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5610ff9640 10 monclient: dump: 2026-02-17T12:07:28.278 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:28.278 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.278 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.278 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.278 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:28.279 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.279 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:28.279 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:28.279 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:28.279 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.279 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f56127fc640 4 set_mon_vals no callback set 2026-02-17T12:07:28.279 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 5 monclient: authenticate success, global_id 4451 2026-02-17T12:07:28.279 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient: _renew_subs 2026-02-17T12:07:28.279 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:28.279 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 1 -- 10.20.193.77:0/2628141076 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5614122570 con 0x7f56140a3290 2026-02-17T12:07:28.279 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient: _renew_subs 2026-02-17T12:07:28.279 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:28.279 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 1 -- 10.20.193.77:0/2628141076 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56140a6790 con 0x7f56140a3290 2026-02-17T12:07:28.279 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:28.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:28.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:28.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f561a8c4640 1 -- 10.20.193.77:0/2628141076 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56140a3a50 con 0x7f56140a3290 2026-02-17T12:07:28.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.255+0000 7f5610ff9640 1 -- 10.20.193.77:0/2628141076 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f5600024060 con 0x7f56140a3290 2026-02-17T12:07:28.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.259+0000 7f5610ff9640 1 --2- 10.20.193.77:0/2628141076 >> v2:10.20.193.119:6800/4127986552 conn(0x7f55e403a120 0x7f55e403c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.259+0000 7f5610ff9640 1 -- 10.20.193.77:0/2628141076 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f560004da40 con 0x7f56140a3290 2026-02-17T12:07:28.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.259+0000 7f56137fe640 1 --2- 10.20.193.77:0/2628141076 >> v2:10.20.193.119:6800/4127986552 conn(0x7f55e403a120 0x7f55e403c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.259+0000 7f56137fe640 10 monclient: get_auth_request con 0x7f55e403a120 auth_method 0 2026-02-17T12:07:28.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.259+0000 7f56137fe640 1 --2- 10.20.193.77:0/2628141076 >> v2:10.20.193.119:6800/4127986552 conn(0x7f55e403a120 0x7f55e403c5e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5614068810 tx=0x7f5604008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:28.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.259+0000 7f5610ff9640 1 -- 10.20.193.77:0/2628141076 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f5600013d50 con 0x7f56140a3290 2026-02-17T12:07:28.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.259+0000 7f5610ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:28.280 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.259+0000 7f5610ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:28.339 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 1 -- 10.20.193.77:0/2628141076 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56141221f0 con 0x7f55e403a120 2026-02-17T12:07:28.340 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f5610ff9640 1 -- 10.20.193.77:0/2628141076 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33975 (secure 0 0 0) 0x7f56141221f0 con 0x7f55e403a120 2026-02-17T12:07:28.341 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:07:28.342 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T12:07:28.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 1 -- 10.20.193.77:0/2628141076 >> v2:10.20.193.119:6800/4127986552 conn(0x7f55e403a120 msgr2=0x7f55e403c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 1 --2- 10.20.193.77:0/2628141076 >> v2:10.20.193.119:6800/4127986552 conn(0x7f55e403a120 0x7f55e403c5e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5614068810 tx=0x7f5604008040 comp rx=0 tx=0).stop 2026-02-17T12:07:28.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 10 monclient: shutdown 2026-02-17T12:07:28.342 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:28.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 1 -- 10.20.193.77:0/2628141076 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 msgr2=0x7f5614122c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 1 --2- 10.20.193.77:0/2628141076 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 0x7f5614122c70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f560000ec10 tx=0x7f560000c520 comp rx=0 tx=0).stop 2026-02-17T12:07:28.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 1 -- 10.20.193.77:0/2628141076 shutdown_connections 2026-02-17T12:07:28.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 1 --2- 10.20.193.77:0/2628141076 >> v2:10.20.193.119:6800/4127986552 conn(0x7f55e403a120 0x7f55e403c5e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 1 --2- 10.20.193.77:0/2628141076 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f5614138540 0x7f561411f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 1 --2- 10.20.193.77:0/2628141076 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f56140a3670 0x7f561411eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 1 --2- 10.20.193.77:0/2628141076 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f56140a3290 0x7f5614122c70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 1 -- 10.20.193.77:0/2628141076 >> 10.20.193.77:0/2628141076 conn(0x7f56140a8890 msgr2=0x7f5614072f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:28.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 1 -- 10.20.193.77:0/2628141076 shutdown_connections 2026-02-17T12:07:28.343 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.335+0000 7f561a8c4640 1 -- 10.20.193.77:0/2628141076 wait complete. 2026-02-17T12:07:28.350 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2026-02-17T12:07:28.280725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":184196,"kb_used_data":1600,"kb_used_omap":9,"kb_used_meta":182454,"kb_avail":566046844,"statfs":{"total":579820584960,"available":579631968256,"internally_reserved":0,"allocated":1638400,"data_stored":1609924,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":186833575},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000995"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567297+0000","last_change":"2026-02-17T12:05:14.474034+0000","last_active":"2026-02-17T12:05:50.567297+0000","last_peered":"2026-02-17T12:05:50.567297+0000","last_clean":"2026-02-17T12:05:50.567297+0000","last_became_active":"2026-02-17T12:05:12.276658+0000","last_became_peered":"2026-02-17T12:05:12.276658+0000","last_unstale":"2026-02-17T12:05:50.567297+0000","last_undegraded":"2026-02-17T12:05:50.567297+0000","last_fullsized":"2026-02-17T12:05:50.567297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:42:47.843930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048223100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.554640+0000","last_change":"2026-02-17T12:05:14.478866+0000","last_active":"2026-02-17T12:05:51.554640+0000","last_peered":"2026-02-17T12:05:51.554640+0000","last_clean":"2026-02-17T12:05:51.554640+0000","last_became_active":"2026-02-17T12:05:12.278326+0000","last_became_peered":"2026-02-17T12:05:12.278326+0000","last_unstale":"2026-02-17T12:05:51.554640+0000","last_undegraded":"2026-02-17T12:05:51.554640+0000","last_fullsized":"2026-02-17T12:05:51.554640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:40:28.089270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031809399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567244+0000","last_change":"2026-02-17T12:05:14.473914+0000","last_active":"2026-02-17T12:05:50.567244+0000","last_peered":"2026-02-17T12:05:50.567244+0000","last_clean":"2026-02-17T12:05:50.567244+0000","last_became_active":"2026-02-17T12:05:12.528026+0000","last_became_peered":"2026-02-17T12:05:12.528026+0000","last_unstale":"2026-02-17T12:05:50.567244+0000","last_undegraded":"2026-02-17T12:05:50.567244+0000","last_fullsized":"2026-02-17T12:05:50.567244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:38:50.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039251500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.554649+0000","last_change":"2026-02-17T12:05:14.478884+0000","last_active":"2026-02-17T12:05:51.554649+0000","last_peered":"2026-02-17T12:05:51.554649+0000","last_clean":"2026-02-17T12:05:51.554649+0000","last_became_active":"2026-02-17T12:05:12.529966+0000","last_became_peered":"2026-02-17T12:05:12.529966+0000","last_unstale":"2026-02-17T12:05:51.554649+0000","last_undegraded":"2026-02-17T12:05:51.554649+0000","last_fullsized":"2026-02-17T12:05:51.554649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:18:45.016861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033970499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.553272+0000","last_change":"2026-02-17T12:05:14.475335+0000","last_active":"2026-02-17T12:05:51.553272+0000","last_peered":"2026-02-17T12:05:51.553272+0000","last_clean":"2026-02-17T12:05:51.553272+0000","last_became_active":"2026-02-17T12:05:12.276436+0000","last_became_peered":"2026-02-17T12:05:12.276436+0000","last_unstale":"2026-02-17T12:05:51.553272+0000","last_undegraded":"2026-02-17T12:05:51.553272+0000","last_fullsized":"2026-02-17T12:05:51.553272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:54:19.820473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054557800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.554560+0000","last_change":"2026-02-17T12:05:14.742903+0000","last_active":"2026-02-17T12:05:51.554560+0000","last_peered":"2026-02-17T12:05:51.554560+0000","last_clean":"2026-02-17T12:05:51.554560+0000","last_became_active":"2026-02-17T12:05:12.278426+0000","last_became_peered":"2026-02-17T12:05:12.278426+0000","last_unstale":"2026-02-17T12:05:51.554560+0000","last_undegraded":"2026-02-17T12:05:51.554560+0000","last_fullsized":"2026-02-17T12:05:51.554560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:36:27.118344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032063000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567254+0000","last_change":"2026-02-17T12:05:14.473834+0000","last_active":"2026-02-17T12:05:50.567254+0000","last_peered":"2026-02-17T12:05:50.567254+0000","last_clean":"2026-02-17T12:05:50.567254+0000","last_became_active":"2026-02-17T12:05:12.276579+0000","last_became_peered":"2026-02-17T12:05:12.276579+0000","last_unstale":"2026-02-17T12:05:50.567254+0000","last_undegraded":"2026-02-17T12:05:50.567254+0000","last_fullsized":"2026-02-17T12:05:50.567254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:36:50.953203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311976,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.553311+0000","last_change":"2026-02-17T12:05:14.475054+0000","last_active":"2026-02-17T12:05:51.553311+0000","last_peered":"2026-02-17T12:05:51.553311+0000","last_clean":"2026-02-17T12:05:51.553311+0000","last_became_active":"2026-02-17T12:05:12.276141+0000","last_became_peered":"2026-02-17T12:05:12.276141+0000","last_unstale":"2026-02-17T12:05:51.553311+0000","last_undegraded":"2026-02-17T12:05:51.553311+0000","last_fullsized":"2026-02-17T12:05:51.553311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:51:25.694043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025524199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'112","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567297+0000","last_change":"2026-02-17T12:05:08.039772+0000","last_active":"2026-02-17T12:05:50.567297+0000","last_peered":"2026-02-17T12:05:50.567297+0000","last_clean":"2026-02-17T12:05:50.567297+0000","last_became_active":"2026-02-17T12:05:08.039610+0000","last_became_peered":"2026-02-17T12:05:08.039610+0000","last_unstale":"2026-02-17T12:05:50.567297+0000","last_undegraded":"2026-02-17T12:05:50.567297+0000","last_fullsized":"2026-02-17T12:05:50.567297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_clean_scrub_stamp":"2026-02-17T12:05:06.954552+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:26:36.107316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":258048,"data_stored":92024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607582,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":253952,"data_stored":92005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607582,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":307200,"data_stored":620933,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607582,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":253952,"data_stored":92005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607582,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":258048,"data_stored":92024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640287,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":307200,"data_stored":620933,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:07:28.352 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T12:07:28.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 10 monclient: get_monmap_and_config 2026-02-17T12:07:28.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 10 monclient: build_initial_monmap 2026-02-17T12:07:28.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 10 monclient: monmap: 2026-02-17T12:07:28.413 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:28.413 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.413 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:28.411367+0000 2026-02-17T12:07:28.414 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:28.411367+0000 2026-02-17T12:07:28.414 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:28.414 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.414 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:28.414 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:28.414 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:28.414 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:28.414 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:28.414 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 1 Processor -- start 2026-02-17T12:07:28.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 1 -- start start 2026-02-17T12:07:28.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 10 monclient: init 2026-02-17T12:07:28.416 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:28.416 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 10 monclient: _add_conns ranks=[1,4,3,2,0] 2026-02-17T12:07:28.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fedc009be20 addr v1:10.20.193.119:6789/0 2026-02-17T12:07:28.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fedc00a4c20 0x7fedc013d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 10 monclient(hunting): picked mon.noname-c con 0x7fedc00a4c20 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:28.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fedc00a5070 0x7fedc013f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 10 monclient(hunting): picked mon.noname-a con 0x7fedc00a5070 addr v2:10.20.193.77:3300/0 2026-02-17T12:07:28.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc0135530 con 0x7fedc009be20 2026-02-17T12:07:28.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fedc009c200 con 0x7fedc00a5070 2026-02-17T12:07:28.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.417 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fedc009cdf0 con 0x7fedc00a4c20 2026-02-17T12:07:28.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:28.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedc5f49640 10 monclient(hunting): authenticate will time out at 700.086920s 2026-02-17T12:07:28.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fedc00a5070 0x7fedc013f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fedc00a5070 0x7fedc013f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:55074/0 (socket says 10.20.193.77:55074) 2026-02-17T12:07:28.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 1 -- 10.20.193.77:0/2758834234 learned_addr learned my addr 10.20.193.77:0/2758834234 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:28.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 10 monclient(hunting): get_auth_request con 0x7fedc00a5070 auth_method 0 2026-02-17T12:07:28.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:28.418 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:28.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbeffd640 1 --2- 10.20.193.77:0/2758834234 >> v2:10.20.193.119:3300/0 conn(0x7fedc00a4c20 0x7fedc013d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:28.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbeffd640 10 monclient(hunting): get_auth_request con 0x7fedc00a4c20 auth_method 0 2026-02-17T12:07:28.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 10 monclient(hunting): handle_auth_done global_id 4470 payload 274 2026-02-17T12:07:28.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 1 -- 10.20.193.77:0/2758834234 >> v2:10.20.193.119:3300/0 conn(0x7fedc00a4c20 msgr2=0x7fedc013d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:28.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 1 --2- 10.20.193.77:0/2758834234 >> v2:10.20.193.119:3300/0 conn(0x7fedc00a4c20 0x7fedc013d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.419 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 1 -- 10.20.193.77:0/2758834234 >> v1:10.20.193.119:6789/0 conn(0x7fedc009be20 legacy=0x7fedc0134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:28.420 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 10 monclient: _finish_hunting 0 2026-02-17T12:07:28.420 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 1 monclient: found mon.noname-a 2026-02-17T12:07:28.420 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:28.420 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:28.420 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.407+0000 7fedbffff640 1 -- 10.20.193.77:0/2758834234 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc009d0d0 con 0x7fedc00a5070 2026-02-17T12:07:28.427 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbffff640 1 -- 10.20.193.77:0/2758834234 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fedc00a5070 msgr2=0x7fedc013f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:28.427 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbffff640 1 --2- 10.20.193.77:0/2758834234 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fedc00a5070 0x7fedc013f9c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fedc00a7cb0 tx=0x7fedb401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab10b89101636b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:28.427 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbe7fc640 1 -- 10.20.193.77:0/2758834234 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb40a5660 con 0x7fedc00a5070 2026-02-17T12:07:28.427 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:28.427 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbe7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:28.427 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbe7fc640 10 monclient: dump: 2026-02-17T12:07:28.427 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:28.428 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.428 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.428 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.428 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:28.428 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.428 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:28.428 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:28.428 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:28.428 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.428 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbe7fc640 10 monclient: _finish_auth 0 2026-02-17T12:07:28.428 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbe7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:07:28.429 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:28.429 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbe7fc640 1 -- 10.20.193.77:0/2758834234 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb40a5800 con 0x7fedc00a5070 2026-02-17T12:07:28.429 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbe7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:28.429 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbe7fc640 1 -- 10.20.193.77:0/2758834234 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb40a5bd0 con 0x7fedc00a5070 2026-02-17T12:07:28.429 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedc5f49640 5 monclient: authenticate success, global_id 4470 2026-02-17T12:07:28.429 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedc5f49640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:28.429 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedc5f49640 4 set_mon_vals no callback set 2026-02-17T12:07:28.429 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:28.429 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:28.429 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedbe7fc640 10 monclient: dump: 2026-02-17T12:07:28.429 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:28.429 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.430 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.430 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.430 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:28.430 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.430 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:28.430 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:28.430 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:28.430 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.430 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedc5f49640 10 monclient: shutdown 2026-02-17T12:07:28.430 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedc5f49640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:28.430 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedc5f49640 1 -- 10.20.193.77:0/2758834234 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fedc00a5070 msgr2=0x7fedc013f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.430 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedc5f49640 1 --2- 10.20.193.77:0/2758834234 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fedc00a5070 0x7fedc013f9c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fedc00a7cb0 tx=0x7fedb401c8d0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.431 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedc5f49640 1 -- 10.20.193.77:0/2758834234 shutdown_connections 2026-02-17T12:07:28.431 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedc5f49640 1 --2- 10.20.193.77:0/2758834234 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fedc00a5070 0x7fedc013f9c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.431 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedc5f49640 1 --2- 10.20.193.77:0/2758834234 >> v2:10.20.193.119:3300/0 conn(0x7fedc00a4c20 0x7fedc013d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.431 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedc5f49640 1 -- 10.20.193.77:0/2758834234 >> 10.20.193.77:0/2758834234 conn(0x7fedc0074ba0 msgr2=0x7fedc00aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:28.431 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedc5f49640 1 -- 10.20.193.77:0/2758834234 shutdown_connections 2026-02-17T12:07:28.431 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.411+0000 7fedc5f49640 1 -- 10.20.193.77:0/2758834234 wait complete. 2026-02-17T12:07:28.431 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient: build_initial_monmap 2026-02-17T12:07:28.431 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient: monmap: 2026-02-17T12:07:28.431 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:28.431 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:28.431 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:28.431 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:28.432 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:28.432 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.432 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:28.432 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:28.432 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:28.432 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.432 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 1 Processor -- start 2026-02-17T12:07:28.432 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 1 -- start start 2026-02-17T12:07:28.432 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient: init 2026-02-17T12:07:28.432 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:28.432 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:07:28.432 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fedc009be20 0x7fedc01d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.432 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient(hunting): picked mon.noname-b con 0x7fedc009be20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:28.433 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fedc00a4c20 0x7fedc00a3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.433 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient(hunting): picked mon.noname-a con 0x7fedc00a4c20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:28.433 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fedc00a5070 0x7fedc00a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.433 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient(hunting): picked mon.noname-c con 0x7fedc00a5070 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:28.433 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.433 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fedc0142ab0 con 0x7fedc00a4c20 2026-02-17T12:07:28.433 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.433 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fedc0142930 con 0x7fedc009be20 2026-02-17T12:07:28.433 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:28.433 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fedc0142c30 con 0x7fedc00a5070 2026-02-17T12:07:28.433 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:28.433 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient(hunting): authenticate will time out at 700.093038s 2026-02-17T12:07:28.434 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbeffd640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fedc00a4c20 0x7fedc00a3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.434 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fedc00a5070 0x7fedc00a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.434 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbeffd640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fedc00a4c20 0x7fedc00a3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:55082/0 (socket says 10.20.193.77:55082) 2026-02-17T12:07:28.434 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbeffd640 1 -- 10.20.193.77:0/4145025400 learned_addr learned my addr 10.20.193.77:0/4145025400 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:28.434 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbeffd640 10 monclient(hunting): get_auth_request con 0x7fedc00a4c20 auth_method 0 2026-02-17T12:07:28.434 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.434 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.434 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.434 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 10 monclient(hunting): get_auth_request con 0x7fedc00a5070 auth_method 0 2026-02-17T12:07:28.434 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.434 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.434 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.435 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbf7fe640 1 --2- 10.20.193.77:0/4145025400 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fedc009be20 0x7fedc01d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.435 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:28.435 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:28.435 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:28.435 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:28.435 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:28.435 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:28.435 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbf7fe640 10 monclient(hunting): get_auth_request con 0x7fedc009be20 auth_method 0 2026-02-17T12:07:28.435 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:28.435 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:28.435 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:28.435 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 10 monclient(hunting): handle_auth_done global_id 4454 payload 824 2026-02-17T12:07:28.435 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 1 -- 10.20.193.77:0/4145025400 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fedc009be20 msgr2=0x7fedc01d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.436 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 1 --2- 10.20.193.77:0/4145025400 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fedc009be20 0x7fedc01d1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.436 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 1 -- 10.20.193.77:0/4145025400 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fedc00a4c20 msgr2=0x7fedc00a3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.436 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 1 --2- 10.20.193.77:0/4145025400 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fedc00a4c20 0x7fedc00a3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.436 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 10 monclient: _finish_hunting 0 2026-02-17T12:07:28.436 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 1 monclient: found mon.noname-c 2026-02-17T12:07:28.436 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:28.436 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:28.436 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 1 -- 10.20.193.77:0/4145025400 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc00a4a10 con 0x7fedc00a5070 2026-02-17T12:07:28.436 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbeffd640 1 --2- 10.20.193.77:0/4145025400 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fedc00a4c20 0x7fedc00a3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:28.436 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 1 -- 10.20.193.77:0/4145025400 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fedc00a5070 msgr2=0x7fedc00a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:28.436 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbffff640 1 --2- 10.20.193.77:0/4145025400 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fedc00a5070 0x7fedc00a44d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fedb40ae000 tx=0x7fedb4019670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:28.436 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fed9bfff640 1 -- 10.20.193.77:0/4145025400 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb40bc020 con 0x7fedc00a5070 2026-02-17T12:07:28.437 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fed9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:28.437 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fed9bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:28.437 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fed9bfff640 10 monclient: dump: 2026-02-17T12:07:28.437 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:28.437 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.437 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.437 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.437 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:28.437 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.437 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:28.437 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:28.437 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:28.438 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.438 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fed9bfff640 10 monclient: _finish_auth 0 2026-02-17T12:07:28.438 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fed9bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:07:28.438 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fed9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:28.438 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fed9bfff640 1 -- 10.20.193.77:0/4145025400 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb40b8a90 con 0x7fedc00a5070 2026-02-17T12:07:28.438 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fed9bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:28.438 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fed9bfff640 1 -- 10.20.193.77:0/4145025400 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb40a5660 con 0x7fedc00a5070 2026-02-17T12:07:28.438 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fed9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:28.438 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fed9bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:28.438 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fed9bfff640 10 monclient: dump: 2026-02-17T12:07:28.438 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:28.438 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:28.439 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.439 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:28.439 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:28.439 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:28.439 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:28.439 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:28.439 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:28.439 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:28.439 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedbdffb640 4 set_mon_vals no callback set 2026-02-17T12:07:28.439 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 5 monclient: authenticate success, global_id 4454 2026-02-17T12:07:28.439 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient: _renew_subs 2026-02-17T12:07:28.439 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:28.439 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 1 -- 10.20.193.77:0/4145025400 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc009f750 con 0x7fedc00a5070 2026-02-17T12:07:28.440 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient: _renew_subs 2026-02-17T12:07:28.440 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:28.440 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.415+0000 7fedc5f49640 1 -- 10.20.193.77:0/4145025400 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc01d21c0 con 0x7fedc00a5070 2026-02-17T12:07:28.440 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.419+0000 7fedc5f49640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:28.440 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.419+0000 7fedc5f49640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:28.440 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.419+0000 7fedc5f49640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:28.440 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.419+0000 7fedc5f49640 1 -- 10.20.193.77:0/4145025400 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedc0134360 con 0x7fedc00a5070 2026-02-17T12:07:28.440 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.419+0000 7fed9bfff640 1 -- 10.20.193.77:0/4145025400 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fedb4003aa0 con 0x7fedc00a5070 2026-02-17T12:07:28.440 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.419+0000 7fed9bfff640 1 --2- 10.20.193.77:0/4145025400 >> v2:10.20.193.119:6800/4127986552 conn(0x7fed9003a170 0x7fed9003c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:28.440 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.419+0000 7fed9bfff640 1 -- 10.20.193.77:0/4145025400 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7fedb40e89e0 con 0x7fedc00a5070 2026-02-17T12:07:28.440 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.419+0000 7fedbf7fe640 1 --2- 10.20.193.77:0/4145025400 >> v2:10.20.193.119:6800/4127986552 conn(0x7fed9003a170 0x7fed9003c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:28.441 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.419+0000 7fedbf7fe640 10 monclient: get_auth_request con 0x7fed9003a170 auth_method 0 2026-02-17T12:07:28.441 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.419+0000 7fedbf7fe640 1 --2- 10.20.193.77:0/4145025400 >> v2:10.20.193.119:6800/4127986552 conn(0x7fed9003a170 0x7fed9003c630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fedac005030 tx=0x7fedac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:28.441 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.423+0000 7fed9bfff640 1 -- 10.20.193.77:0/4145025400 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7fedb40c6070 con 0x7fedc00a5070 2026-02-17T12:07:28.441 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.423+0000 7fed9bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:28.441 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.423+0000 7fed9bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:28.502 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.495+0000 7fedc5f49640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:07:28.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.495+0000 7fedc5f49640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:07:28.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.495+0000 7fedc5f49640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:28.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.495+0000 7fedc5f49640 1 -- 10.20.193.77:0/4145025400 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fedc0134e00 con 0x7fedc00a5070 2026-02-17T12:07:28.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fed9bfff640 1 -- 10.20.193.77:0/4145025400 <== mon.2 v2:10.20.193.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+10869 (secure 0 0 0) 0x7fedb40165e0 con 0x7fedc00a5070 2026-02-17T12:07:28.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fed9bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T12:07:28.503 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fed9bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:28.504 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:07:28.504 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":29,"fsid":"093d53f2-7cd0-4506-a27d-4c950e190615","created":"2026-02-17T12:04:53.336611+0000","modified":"2026-02-17T12:05:50.564786+0000","last_up_change":"2026-02-17T12:05:05.953164+0000","last_in_change":"2026-02-17T12:04:55.265712+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T12:05:06.312998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T12:05:10.954009+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad6780fd-cb0e-481f-8816-a32e3434b102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6800","nonce":1107649769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":1107649769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1107649769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":1107649769}]},"public_addr":"10.20.193.77:6800/1107649769","cluster_addr":"10.20.193.77:6802/1107649769","heartbeat_back_addr":"10.20.193.77:6806/1107649769","heartbeat_front_addr":"10.20.193.77:6804/1107649769","state":["exists","up"]},{"osd":1,"uuid":"a82a493e-88de-4b65-ab23-41b52ffb6b61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":662135547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":662135547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":662135547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":662135547}]},"public_addr":"10.20.193.77:6801/662135547","cluster_addr":"10.20.193.77:6803/662135547","heartbeat_back_addr":"10.20.193.77:6807/662135547","heartbeat_front_addr":"10.20.193.77:6805/662135547","state":["exists","up"]},{"osd":2,"uuid":"02ae9c66-fa9e-46d2-8be5-ba695ba4763b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":3812083705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":3812083705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":3812083705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":3812083705}]},"public_addr":"10.20.193.77:6808/3812083705","cluster_addr":"10.20.193.77:6809/3812083705","heartbeat_back_addr":"10.20.193.77:6811/3812083705","heartbeat_front_addr":"10.20.193.77:6810/3812083705","state":["exists","up"]},{"osd":3,"uuid":"fe40e683-451d-4e8a-94f4-69ace432df28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6801","nonce":3041501560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6802","nonce":3041501560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6804","nonce":3041501560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6803","nonce":3041501560}]},"public_addr":"10.20.193.119:6801/3041501560","cluster_addr":"10.20.193.119:6802/3041501560","heartbeat_back_addr":"10.20.193.119:6804/3041501560","heartbeat_front_addr":"10.20.193.119:6803/3041501560","state":["exists","up"]},{"osd":4,"uuid":"e6fc84bb-bd81-49d5-8cfd-b4ab0468d8dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6805","nonce":4132502681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6806","nonce":4132502681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6808","nonce":4132502681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6807","nonce":4132502681}]},"public_addr":"10.20.193.119:6805/4132502681","cluster_addr":"10.20.193.119:6806/4132502681","heartbeat_back_addr":"10.20.193.119:6808/4132502681","heartbeat_front_addr":"10.20.193.119:6807/4132502681","state":["exists","up"]},{"osd":5,"uuid":"400ef2a1-c8ee-4376-b3d9-588e2a34ad9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6809","nonce":3174335982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6810","nonce":3174335982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6812","nonce":3174335982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.119:6811","nonce":3174335982}]},"public_addr":"10.20.193.119:6809/3174335982","cluster_addr":"10.20.193.119:6810/3174335982","heartbeat_back_addr":"10.20.193.119:6812/3174335982","heartbeat_front_addr":"10.20.193.119:6811/3174335982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:05:02.255439+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:05:02.249624+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:05:02.410809+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:05:02.338652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:05:02.993567+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:05:03.308889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:07:28.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fedc5f49640 1 -- 10.20.193.77:0/4145025400 >> v2:10.20.193.119:6800/4127986552 conn(0x7fed9003a170 msgr2=0x7fed9003c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fedc5f49640 1 --2- 10.20.193.77:0/4145025400 >> v2:10.20.193.119:6800/4127986552 conn(0x7fed9003a170 0x7fed9003c630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fedac005030 tx=0x7fedac009040 comp rx=0 tx=0).stop 2026-02-17T12:07:28.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fedc5f49640 10 monclient: shutdown 2026-02-17T12:07:28.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fedc5f49640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:28.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fedc5f49640 1 -- 10.20.193.77:0/4145025400 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fedc00a5070 msgr2=0x7fedc00a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:28.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fedc5f49640 1 --2- 10.20.193.77:0/4145025400 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fedc00a5070 0x7fedc00a44d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fedb40ae000 tx=0x7fedb4019670 comp rx=0 tx=0).stop 2026-02-17T12:07:28.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fedc5f49640 1 -- 10.20.193.77:0/4145025400 shutdown_connections 2026-02-17T12:07:28.505 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fedc5f49640 1 --2- 10.20.193.77:0/4145025400 >> v2:10.20.193.119:6800/4127986552 conn(0x7fed9003a170 0x7fed9003c630 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fedc5f49640 1 --2- 10.20.193.77:0/4145025400 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fedc00a5070 0x7fedc00a44d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fedc5f49640 1 --2- 10.20.193.77:0/4145025400 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fedc00a4c20 0x7fedc00a3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fedc5f49640 1 --2- 10.20.193.77:0/4145025400 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fedc009be20 0x7fedc01d1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:28.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fedc5f49640 1 -- 10.20.193.77:0/4145025400 >> 10.20.193.77:0/4145025400 conn(0x7fedc0074ba0 msgr2=0x7fedc00a9890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:28.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fedc5f49640 1 -- 10.20.193.77:0/4145025400 shutdown_connections 2026-02-17T12:07:28.506 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:28.499+0000 7fedc5f49640 1 -- 10.20.193.77:0/4145025400 wait complete. 2026-02-17T12:07:29.514 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T12:07:29.514 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:07:29.587 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 10 monclient: get_monmap_and_config 2026-02-17T12:07:29.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 10 monclient: build_initial_monmap 2026-02-17T12:07:29.588 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 10 monclient: monmap: 2026-02-17T12:07:29.588 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:29.588 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.588 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:29.586470+0000 2026-02-17T12:07:29.588 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:29.586470+0000 2026-02-17T12:07:29.589 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:29.589 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.589 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:29.589 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:29.589 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:29.589 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:29.589 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:29.589 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.601 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 1 Processor -- start 2026-02-17T12:07:29.601 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 1 -- start start 2026-02-17T12:07:29.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 10 monclient: init 2026-02-17T12:07:29.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:29.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 10 monclient: _add_conns ranks=[2,3,0,4,1] 2026-02-17T12:07:29.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa7740a6750 0x7fa7740a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 10 monclient(hunting): picked mon.noname-b con 0x7fa7740a6750 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:29.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fa77409be20 0x7fa774134b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 10 monclient(hunting): picked mon.noname-a con 0x7fa77409be20 addr v2:10.20.193.77:3300/0 2026-02-17T12:07:29.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa774138a60 addr v1:10.20.193.77:6789/0 2026-02-17T12:07:29.602 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa77409cf40 con 0x7fa774138a60 2026-02-17T12:07:29.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa77409c2e0 con 0x7fa77409be20 2026-02-17T12:07:29.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa77409d220 con 0x7fa7740a6750 2026-02-17T12:07:29.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:29.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa779930640 10 monclient(hunting): authenticate will time out at 701.262322s 2026-02-17T12:07:29.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa7740a6750 0x7fa7740a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa7727fc640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fa77409be20 0x7fa774134b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa7740a6750 0x7fa7740a6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:59386/0 (socket says 10.20.193.77:59386) 2026-02-17T12:07:29.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa7737fe640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7fa774138a60 0x7fa774135040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:51622/0 (socket says 10.20.193.77:51622) 2026-02-17T12:07:29.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 1 -- 10.20.193.77:0/3589651111 learned_addr learned my addr 10.20.193.77:0/3589651111 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:29.603 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 10 monclient(hunting): get_auth_request con 0x7fa7740a6750 auth_method 0 2026-02-17T12:07:29.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa7727fc640 10 monclient(hunting): get_auth_request con 0x7fa77409be20 auth_method 0 2026-02-17T12:07:29.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa7727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa7727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa7727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa7727fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.604 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa7727fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa7727fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 10 monclient(hunting): handle_auth_done global_id 4457 payload 274 2026-02-17T12:07:29.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 1 -- 10.20.193.77:0/3589651111 >> v2:10.20.193.77:3300/0 conn(0x7fa77409be20 msgr2=0x7fa774134b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:29.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 1 --2- 10.20.193.77:0/3589651111 >> v2:10.20.193.77:3300/0 conn(0x7fa77409be20 0x7fa774134b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 1 -- 10.20.193.77:0/3589651111 >> v1:10.20.193.77:6789/0 conn(0x7fa774138a60 legacy=0x7fa774135040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:29.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:29.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 1 monclient: found mon.noname-b 2026-02-17T12:07:29.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:29.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa772ffd640 1 -- 10.20.193.77:0/3589651111 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7740a7070 con 0x7fa7740a6750 2026-02-17T12:07:29.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.583+0000 7fa7727fc640 1 --2- 10.20.193.77:0/3589651111 >> v2:10.20.193.77:3300/0 conn(0x7fa77409be20 0x7fa774134b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:29.605 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa772ffd640 1 -- 10.20.193.77:0/3589651111 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa7740a6750 msgr2=0x7fa7740a6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:29.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa772ffd640 1 --2- 10.20.193.77:0/3589651111 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa7740a6750 0x7fa7740a6b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa768009970 tx=0x7fa76801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21196e3014bd0f20 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa771ffb640 1 -- 10.20.193.77:0/3589651111 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7680b0070 con 0x7fa7740a6750 2026-02-17T12:07:29.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa771ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa771ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:29.606 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa771ffb640 10 monclient: dump: 2026-02-17T12:07:29.606 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.606 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.606 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.606 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.606 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.606 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.606 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.607 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.607 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.607 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa771ffb640 10 monclient: _finish_auth 0 2026-02-17T12:07:29.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa771ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:07:29.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa771ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:29.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa771ffb640 1 -- 10.20.193.77:0/3589651111 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa768004230 con 0x7fa7740a6750 2026-02-17T12:07:29.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa771ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:29.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa771ffb640 1 -- 10.20.193.77:0/3589651111 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768003720 con 0x7fa7740a6750 2026-02-17T12:07:29.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 5 monclient: authenticate success, global_id 4457 2026-02-17T12:07:29.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:29.607 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 4 set_mon_vals no callback set 2026-02-17T12:07:29.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa771ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa771ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:29.608 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa771ffb640 10 monclient: dump: 2026-02-17T12:07:29.608 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.608 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.608 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.608 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.608 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.608 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.608 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.608 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.608 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.609 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient: shutdown 2026-02-17T12:07:29.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:29.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 -- 10.20.193.77:0/3589651111 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa7740a6750 msgr2=0x7fa7740a6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 --2- 10.20.193.77:0/3589651111 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa7740a6750 0x7fa7740a6b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa768009970 tx=0x7fa76801c480 comp rx=0 tx=0).stop 2026-02-17T12:07:29.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 -- 10.20.193.77:0/3589651111 shutdown_connections 2026-02-17T12:07:29.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 --2- 10.20.193.77:0/3589651111 >> v2:10.20.193.77:3300/0 conn(0x7fa77409be20 0x7fa774134b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 --2- 10.20.193.77:0/3589651111 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa7740a6750 0x7fa7740a6b30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 -- 10.20.193.77:0/3589651111 >> 10.20.193.77:0/3589651111 conn(0x7fa7740aad40 msgr2=0x7fa7740ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:29.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 -- 10.20.193.77:0/3589651111 shutdown_connections 2026-02-17T12:07:29.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 -- 10.20.193.77:0/3589651111 wait complete. 2026-02-17T12:07:29.609 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient: build_initial_monmap 2026-02-17T12:07:29.610 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient: monmap: 2026-02-17T12:07:29.610 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:29.610 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:29.610 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:29.610 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:29.610 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:29.610 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.610 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:29.610 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:29.610 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:29.610 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.610 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 Processor -- start 2026-02-17T12:07:29.610 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 -- start start 2026-02-17T12:07:29.611 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient: init 2026-02-17T12:07:29.611 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:29.611 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:07:29.611 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa77409be20 0x7fa77413e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.611 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient(hunting): picked mon.noname-c con 0x7fa77409be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:29.611 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa7740a6750 0x7fa77413e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.611 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient(hunting): picked mon.noname-b con 0x7fa7740a6750 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:29.611 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa774138a60 0x7fa7741d1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.611 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient(hunting): picked mon.noname-a con 0x7fa774138a60 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:29.611 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.611 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa774142ce0 con 0x7fa774138a60 2026-02-17T12:07:29.612 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.612 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa774142b60 con 0x7fa7740a6750 2026-02-17T12:07:29.612 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.612 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa774142e60 con 0x7fa77409be20 2026-02-17T12:07:29.612 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:29.612 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa779930640 10 monclient(hunting): authenticate will time out at 701.267815s 2026-02-17T12:07:29.612 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa772ffd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa77409be20 0x7fa77413e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.612 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa7737fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa774138a60 0x7fa7741d1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.612 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa772ffd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa77409be20 0x7fa77413e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:59390/0 (socket says 10.20.193.77:59390) 2026-02-17T12:07:29.612 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa772ffd640 1 -- 10.20.193.77:0/3909610798 learned_addr learned my addr 10.20.193.77:0/3909610798 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:29.612 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa772ffd640 10 monclient(hunting): get_auth_request con 0x7fa77409be20 auth_method 0 2026-02-17T12:07:29.612 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa772ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.613 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa772ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.613 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa772ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.613 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa7737fe640 10 monclient(hunting): get_auth_request con 0x7fa774138a60 auth_method 0 2026-02-17T12:07:29.613 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa7737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.613 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa7737fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.613 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa7737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.613 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa772ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.613 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa772ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.613 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa772ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.613 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa7737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.613 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa7737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.613 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.587+0000 7fa7737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.613 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7727fc640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa7740a6750 0x7fa77413e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.614 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7727fc640 10 monclient(hunting): get_auth_request con 0x7fa7740a6750 auth_method 0 2026-02-17T12:07:29.614 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.614 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.614 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.614 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 10 monclient(hunting): handle_auth_done global_id 4479 payload 824 2026-02-17T12:07:29.614 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 1 -- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa77409be20 msgr2=0x7fa77413e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.614 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa77409be20 0x7fa77413e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.614 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 1 -- 10.20.193.77:0/3909610798 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa7740a6750 msgr2=0x7fa77413e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.614 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa7740a6750 0x7fa77413e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.614 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 10 monclient: _finish_hunting 0 2026-02-17T12:07:29.614 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 1 monclient: found mon.noname-a 2026-02-17T12:07:29.614 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:29.615 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:29.615 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 1 -- 10.20.193.77:0/3909610798 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77413fdc0 con 0x7fa774138a60 2026-02-17T12:07:29.615 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa77409be20 0x7fa77413e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:29.615 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 1 -- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa774138a60 msgr2=0x7fa7741d1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:29.615 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa774138a60 0x7fa7741d1f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa76400cac0 tx=0x7fa76400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.615 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa764017070 con 0x7fa774138a60 2026-02-17T12:07:29.615 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.615 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:29.615 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient: dump: 2026-02-17T12:07:29.615 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.615 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.615 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.616 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.616 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.616 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.616 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.616 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.616 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.616 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.616 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient: _finish_auth 0 2026-02-17T12:07:29.616 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient: _check_auth_tickets 2026-02-17T12:07:29.616 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:29.616 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa764012400 con 0x7fa774138a60 2026-02-17T12:07:29.616 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:29.617 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76400ae60 con 0x7fa774138a60 2026-02-17T12:07:29.617 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.617 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:29.617 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7717fa640 4 set_mon_vals no callback set 2026-02-17T12:07:29.617 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient: dump: 2026-02-17T12:07:29.617 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.617 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.617 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.617 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.617 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.617 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.617 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.617 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.618 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.618 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa779930640 5 monclient: authenticate success, global_id 4479 2026-02-17T12:07:29.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa779930640 10 monclient: _renew_subs 2026-02-17T12:07:29.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa779930640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:29.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa779930640 1 -- 10.20.193.77:0/3909610798 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77409f8e0 con 0x7fa774138a60 2026-02-17T12:07:29.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa779930640 10 monclient: _renew_subs 2026-02-17T12:07:29.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa779930640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:29.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa779930640 1 -- 10.20.193.77:0/3909610798 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa77409f600 con 0x7fa774138a60 2026-02-17T12:07:29.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 1 -- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa774138a60 msgr2=0x7fa7741d1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T12:07:29.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 1 -- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa774138a60 msgr2=0x7fa7741d1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:07:29.618 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa774138a60 0x7fa7741d1f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa76400cac0 tx=0x7fa76400cf80 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:29.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa774138a60 0x7fa7741d1f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa76400cac0 tx=0x7fa76400cf80 comp rx=0 tx=0).stop 2026-02-17T12:07:29.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient: ms_handle_reset current mon [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:29.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:29.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa774138a60 msgr2=0x7fa7741d1f20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:29.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa774138a60 0x7fa7741d1f20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:07:29.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa77409be20 0x7fa7440059d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient(hunting): picked mon.c con 0x7fa77409be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:29.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa7440063a0 0x7fa744008830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient(hunting): picked mon.a con 0x7fa7440063a0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:29.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa7740a6750 0x7fa74400b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.619 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient(hunting): picked mon.b con 0x7fa7740a6750 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:29.620 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.620 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa74400bd60 con 0x7fa7440063a0 2026-02-17T12:07:29.620 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.620 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa74400bee0 con 0x7fa7740a6750 2026-02-17T12:07:29.620 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.620 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa74400c060 con 0x7fa77409be20 2026-02-17T12:07:29.620 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa74bfff640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:29.620 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa77409be20 0x7fa7440059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.620 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7727fc640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa7440063a0 0x7fa744008830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.620 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 10 monclient(hunting): get_auth_request con 0x7fa77409be20 auth_method 0 2026-02-17T12:07:29.620 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.620 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:29.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7727fc640 10 monclient(hunting): get_auth_request con 0x7fa7440063a0 auth_method 0 2026-02-17T12:07:29.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7727fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:29.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:07:29.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7727fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7727fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7727fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:07:29.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa7740a6750 0x7fa74400b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.621 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 10 monclient(hunting): get_auth_request con 0x7fa7740a6750 auth_method 0 2026-02-17T12:07:29.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7737fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:29.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 10 monclient(hunting): handle_auth_done global_id 4479 payload 293 2026-02-17T12:07:29.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 1 -- 10.20.193.77:0/3909610798 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa7740a6750 msgr2=0x7fa74400b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fa7740a6750 0x7fa74400b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 1 -- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa7440063a0 msgr2=0x7fa744008830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa7440063a0 0x7fa744008830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:29.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 1 monclient: found mon.c 2026-02-17T12:07:29.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:29.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.622 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 1 -- 10.20.193.77:0/3909610798 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7fa74400c390 con 0x7fa77409be20 2026-02-17T12:07:29.623 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.623 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 1 -- 10.20.193.77:0/3909610798 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7740a45e0 con 0x7fa77409be20 2026-02-17T12:07:29.623 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 10 monclient: _finish_auth 0 2026-02-17T12:07:29.623 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:07:29.623 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa772ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:29.623 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.591+0000 7fa7727fc640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fa7440063a0 0x7fa744008830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:29.623 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa772ffd640 1 -- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa77409be20 msgr2=0x7fa7440059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:29.623 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa772ffd640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa77409be20 0x7fa7440059d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa76801ab30 tx=0x7fa764005440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.623 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.623 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_get_version(what=osdmap handle=2) -- 0x7fa74400c6e0 con 0x7fa77409be20 2026-02-17T12:07:29.623 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7680b0040 con 0x7fa77409be20 2026-02-17T12:07:29.623 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.623 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:29.624 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 10 monclient: dump: 2026-02-17T12:07:29.624 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.624 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.624 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.624 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.624 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.624 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.624 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.624 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.624 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.624 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.624 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa74400c6e0 con 0x7fa77409be20 2026-02-17T12:07:29.624 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:29.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa770ff9640 4 set_mon_vals no callback set 2026-02-17T12:07:29.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fa7680c0070 con 0x7fa77409be20 2026-02-17T12:07:29.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 1 --2- 10.20.193.77:0/3909610798 >> v2:10.20.193.119:6800/4127986552 conn(0x7fa774138a60 0x7fa744044b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 <== mon.2 v2:10.20.193.77:3301/0 4 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7fa7680e6670 con 0x7fa77409be20 2026-02-17T12:07:29.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 1 --2- 10.20.193.77:0/3909610798 >> v2:10.20.193.77:6800/1107649769 conn(0x7fa744047fd0 0x7fa74404a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 --> v2:10.20.193.77:6800/1107649769 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7680b8e80 con 0x7fa744047fd0 2026-02-17T12:07:29.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 <== mon.2 v2:10.20.193.77:3301/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa7680e6950 con 0x7fa77409be20 2026-02-17T12:07:29.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-17T12:07:29.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_get_version_reply(handle=2 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa7680e6bb0 con 0x7fa77409be20 2026-02-17T12:07:29.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa74bfff640 10 monclient: handle_get_version_reply finishing 2 version 29 2026-02-17T12:07:29.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa7737fe640 1 --2- 10.20.193.77:0/3909610798 >> v2:10.20.193.77:6800/1107649769 conn(0x7fa744047fd0 0x7fa74404a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa7737fe640 10 monclient: get_auth_request con 0x7fa744047fd0 auth_method 0 2026-02-17T12:07:29.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa7727fc640 1 --2- 10.20.193.77:0/3909610798 >> v2:10.20.193.119:6800/4127986552 conn(0x7fa774138a60 0x7fa744044b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.595+0000 7fa7727fc640 10 monclient: get_auth_request con 0x7fa774138a60 auth_method 0 2026-02-17T12:07:29.626 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.599+0000 7fa7727fc640 1 --2- 10.20.193.77:0/3909610798 >> v2:10.20.193.119:6800/4127986552 conn(0x7fa774138a60 0x7fa744044b00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa77409e560 tx=0x7fa75c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.626 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.599+0000 7fa7737fe640 1 --2- 10.20.193.77:0/3909610798 >> v2:10.20.193.77:6800/1107649769 conn(0x7fa744047fd0 0x7fa74404a3f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.627 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.599+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 <== osd.0 v2:10.20.193.77:6800/1107649769 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fa7680b8e80 con 0x7fa744047fd0 2026-02-17T12:07:29.627 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa779930640 1 -- 10.20.193.77:0/3909610798 --> v2:10.20.193.77:6800/1107649769 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa7740a6b30 con 0x7fa744047fd0 2026-02-17T12:07:29.627 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa74bfff640 1 -- 10.20.193.77:0/3909610798 <== osd.0 v2:10.20.193.77:6800/1107649769 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa7740a6b30 con 0x7fa744047fd0 2026-02-17T12:07:29.627 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T12:07:29.627 INFO:teuthology.orchestra.run.trial077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:07:29.627 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T12:07:29.629 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa779930640 1 -- 10.20.193.77:0/3909610798 >> v2:10.20.193.77:6800/1107649769 conn(0x7fa744047fd0 msgr2=0x7fa74404a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.629 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa779930640 1 --2- 10.20.193.77:0/3909610798 >> v2:10.20.193.77:6800/1107649769 conn(0x7fa744047fd0 0x7fa74404a3f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.629 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa779930640 1 -- 10.20.193.77:0/3909610798 >> v2:10.20.193.119:6800/4127986552 conn(0x7fa774138a60 msgr2=0x7fa744044b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.629 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa779930640 1 --2- 10.20.193.77:0/3909610798 >> v2:10.20.193.119:6800/4127986552 conn(0x7fa774138a60 0x7fa744044b00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa77409e560 tx=0x7fa75c008040 comp rx=0 tx=0).stop 2026-02-17T12:07:29.629 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa779930640 10 monclient: shutdown 2026-02-17T12:07:29.629 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa779930640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:29.629 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa779930640 1 -- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa77409be20 msgr2=0x7fa7440059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.629 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa779930640 1 --2- 10.20.193.77:0/3909610798 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fa77409be20 0x7fa7440059d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa76801ab30 tx=0x7fa764005440 comp rx=0 tx=0).stop 2026-02-17T12:07:29.629 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa7737fe640 1 -- 10.20.193.77:0/3909610798 reap_dead start 2026-02-17T12:07:29.629 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa779930640 1 -- 10.20.193.77:0/3909610798 shutdown_connections 2026-02-17T12:07:29.629 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa779930640 1 -- 10.20.193.77:0/3909610798 >> 10.20.193.77:0/3909610798 conn(0x7fa7740aad40 msgr2=0x7fa7740a8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:29.629 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa779930640 1 -- 10.20.193.77:0/3909610798 shutdown_connections 2026-02-17T12:07:29.629 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.607+0000 7fa779930640 1 -- 10.20.193.77:0/3909610798 wait complete. 2026-02-17T12:07:29.630 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T12:07:29.691 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 10 monclient: get_monmap_and_config 2026-02-17T12:07:29.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 10 monclient: build_initial_monmap 2026-02-17T12:07:29.692 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 10 monclient: monmap: 2026-02-17T12:07:29.692 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:29.692 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.692 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:29.688301+0000 2026-02-17T12:07:29.692 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:29.688301+0000 2026-02-17T12:07:29.692 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:29.692 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.692 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:29.692 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:29.693 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:29.693 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:29.693 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:29.693 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 1 Processor -- start 2026-02-17T12:07:29.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 1 -- start start 2026-02-17T12:07:29.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 10 monclient: init 2026-02-17T12:07:29.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:29.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 10 monclient: _add_conns ranks=[4,0,2,1,3] 2026-02-17T12:07:29.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7fe57c0a3300 0x7fe57c0a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 10 monclient(hunting): picked mon.noname-c con 0x7fe57c0a3300 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:29.693 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe57c06da30 addr v1:10.20.193.77:6789/0 2026-02-17T12:07:29.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c0a3c20 0x7fe57c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 10 monclient(hunting): picked mon.noname-b con 0x7fe57c0a3c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:29.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe57c0a4a40 con 0x7fe57c06da30 2026-02-17T12:07:29.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe57c06eee0 con 0x7fe57c0a3300 2026-02-17T12:07:29.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe57c06f130 con 0x7fe57c0a3c20 2026-02-17T12:07:29.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:29.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe5823b6640 10 monclient(hunting): authenticate will time out at 701.363725s 2026-02-17T12:07:29.694 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe58092c640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c0a3c20 0x7fe57c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe57b7fe640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7fe57c06da30 0x7fe57c1385b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:51636/0 (socket says 10.20.193.77:51636) 2026-02-17T12:07:29.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe57b7fe640 1 -- 10.20.193.77:0/2944645783 learned_addr learned my addr 10.20.193.77:0/2944645783 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:07:29.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe58092c640 10 monclient(hunting): get_auth_request con 0x7fe57c0a3c20 auth_method 0 2026-02-17T12:07:29.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe58092c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe58092c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe58092c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe57bfff640 1 --2- 10.20.193.77:0/2944645783 >> v2:10.20.193.119:3300/0 conn(0x7fe57c0a3300 0x7fe57c0a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe57bfff640 10 monclient(hunting): get_auth_request con 0x7fe57c0a3300 auth_method 0 2026-02-17T12:07:29.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe57bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe57bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe57bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.695 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe58092c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.683+0000 7fe58092c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe58092c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe57bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe57bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe57bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe58092c640 10 monclient(hunting): handle_auth_done global_id 4463 payload 274 2026-02-17T12:07:29.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe58092c640 1 -- 10.20.193.77:0/2944645783 >> v2:10.20.193.119:3300/0 conn(0x7fe57c0a3300 msgr2=0x7fe57c0a36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:29.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe58092c640 1 --2- 10.20.193.77:0/2944645783 >> v2:10.20.193.119:3300/0 conn(0x7fe57c0a3300 0x7fe57c0a36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe58092c640 1 -- 10.20.193.77:0/2944645783 >> v1:10.20.193.77:6789/0 conn(0x7fe57c06da30 legacy=0x7fe57c1385b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:29.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe58092c640 10 monclient: _finish_hunting 0 2026-02-17T12:07:29.696 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe58092c640 1 monclient: found mon.noname-b 2026-02-17T12:07:29.697 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe58092c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:29.697 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe58092c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.697 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe58092c640 1 -- 10.20.193.77:0/2944645783 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe57c0a4c80 con 0x7fe57c0a3c20 2026-02-17T12:07:29.704 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe58092c640 1 -- 10.20.193.77:0/2944645783 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c0a3c20 msgr2=0x7fe57c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:29.704 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.687+0000 7fe58092c640 1 --2- 10.20.193.77:0/2944645783 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c0a3c20 0x7fe57c138cc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe57c071950 tx=0x7fe57001c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86bba05af54d410d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.704 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57affd640 1 -- 10.20.193.77:0/2944645783 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5700ac070 con 0x7fe57c0a3c20 2026-02-17T12:07:29.704 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.704 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:29.704 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57affd640 10 monclient: dump: 2026-02-17T12:07:29.704 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.705 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.705 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.705 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.705 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.705 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.705 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.705 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.705 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.705 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.705 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57affd640 10 monclient: _finish_auth 0 2026-02-17T12:07:29.705 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57affd640 10 monclient: _check_auth_tickets 2026-02-17T12:07:29.705 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:29.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57affd640 1 -- 10.20.193.77:0/2944645783 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5700a6660 con 0x7fe57c0a3c20 2026-02-17T12:07:29.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:29.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57affd640 1 -- 10.20.193.77:0/2944645783 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5700a6a30 con 0x7fe57c0a3c20 2026-02-17T12:07:29.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:29.706 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57affd640 10 monclient: dump: 2026-02-17T12:07:29.706 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.706 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.706 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.706 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.706 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.706 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.707 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.707 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.707 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.707 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 5 monclient: authenticate success, global_id 4463 2026-02-17T12:07:29.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:29.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 4 set_mon_vals no callback set 2026-02-17T12:07:29.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient: shutdown 2026-02-17T12:07:29.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:29.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 -- 10.20.193.77:0/2944645783 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c0a3c20 msgr2=0x7fe57c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 --2- 10.20.193.77:0/2944645783 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c0a3c20 0x7fe57c138cc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe57c071950 tx=0x7fe57001c810 comp rx=0 tx=0).stop 2026-02-17T12:07:29.707 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 -- 10.20.193.77:0/2944645783 shutdown_connections 2026-02-17T12:07:29.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 --2- 10.20.193.77:0/2944645783 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c0a3c20 0x7fe57c138cc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 --2- 10.20.193.77:0/2944645783 >> v2:10.20.193.119:3300/0 conn(0x7fe57c0a3300 0x7fe57c0a36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 -- 10.20.193.77:0/2944645783 >> 10.20.193.77:0/2944645783 conn(0x7fe57c0a8900 msgr2=0x7fe57c0a8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:29.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 -- 10.20.193.77:0/2944645783 shutdown_connections 2026-02-17T12:07:29.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 -- 10.20.193.77:0/2944645783 wait complete. 2026-02-17T12:07:29.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient: build_initial_monmap 2026-02-17T12:07:29.708 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient: monmap: 2026-02-17T12:07:29.708 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:29.708 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:29.708 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:29.708 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:29.708 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:29.708 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.709 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:29.709 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:29.709 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:29.709 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 Processor -- start 2026-02-17T12:07:29.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 -- start start 2026-02-17T12:07:29.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient: init 2026-02-17T12:07:29.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:29.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:07:29.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c06da30 0x7fe57c1cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient(hunting): picked mon.noname-c con 0x7fe57c06da30 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:29.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe57c0a3300 0x7fe57c138890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.709 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient(hunting): picked mon.noname-b con 0x7fe57c0a3300 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:29.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe57c0a3c20 0x7fe57c1d2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient(hunting): picked mon.noname-a con 0x7fe57c0a3c20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:29.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe57c139380 con 0x7fe57c0a3c20 2026-02-17T12:07:29.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe57c139200 con 0x7fe57c0a3300 2026-02-17T12:07:29.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe57c143030 con 0x7fe57c06da30 2026-02-17T12:07:29.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:29.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe5823b6640 10 monclient(hunting): authenticate will time out at 701.369893s 2026-02-17T12:07:29.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c06da30 0x7fe57c1cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.710 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c06da30 0x7fe57c1cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:59404/0 (socket says 10.20.193.77:59404) 2026-02-17T12:07:29.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 1 -- 10.20.193.77:0/227341902 learned_addr learned my addr 10.20.193.77:0/227341902 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:29.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 10 monclient(hunting): get_auth_request con 0x7fe57c06da30 auth_method 0 2026-02-17T12:07:29.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe58092c640 1 --2- 10.20.193.77:0/227341902 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe57c0a3c20 0x7fe57c1d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe58092c640 10 monclient(hunting): get_auth_request con 0x7fe57c0a3c20 auth_method 0 2026-02-17T12:07:29.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe58092c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe58092c640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe58092c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.711 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57b7fe640 1 --2- 10.20.193.77:0/227341902 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe57c0a3300 0x7fe57c138890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe58092c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe58092c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe58092c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57b7fe640 10 monclient(hunting): get_auth_request con 0x7fe57c0a3300 auth_method 0 2026-02-17T12:07:29.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 10 monclient(hunting): handle_auth_done global_id 4466 payload 824 2026-02-17T12:07:29.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 1 -- 10.20.193.77:0/227341902 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe57c0a3300 msgr2=0x7fe57c138890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 1 --2- 10.20.193.77:0/227341902 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe57c0a3300 0x7fe57c138890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.712 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 1 -- 10.20.193.77:0/227341902 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe57c0a3c20 msgr2=0x7fe57c1d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 1 --2- 10.20.193.77:0/227341902 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe57c0a3c20 0x7fe57c1d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:07:29.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 1 monclient: found mon.noname-c 2026-02-17T12:07:29.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:29.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe57bfff640 1 -- 10.20.193.77:0/227341902 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe57c0a6d80 con 0x7fe57c06da30 2026-02-17T12:07:29.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.691+0000 7fe58092c640 1 --2- 10.20.193.77:0/227341902 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe57c0a3c20 0x7fe57c1d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:29.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe57bfff640 1 -- 10.20.193.77:0/227341902 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c06da30 msgr2=0x7fe57c1cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:29.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe57bfff640 1 --2- 10.20.193.77:0/227341902 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c06da30 0x7fe57c1cef50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe56800e9b0 tx=0x7fe56800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 1 -- 10.20.193.77:0/227341902 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe568017070 con 0x7fe57c06da30 2026-02-17T12:07:29.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:29.713 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 10 monclient: dump: 2026-02-17T12:07:29.714 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.714 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.714 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.714 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.714 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.714 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.714 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.714 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.714 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.714 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.714 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 10 monclient: _finish_auth 0 2026-02-17T12:07:29.714 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:07:29.715 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:29.715 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 1 -- 10.20.193.77:0/227341902 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe56800cc10 con 0x7fe57c06da30 2026-02-17T12:07:29.715 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:29.715 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 1 -- 10.20.193.77:0/227341902 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe568013470 con 0x7fe57c06da30 2026-02-17T12:07:29.715 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.715 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:29.715 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 10 monclient: dump: 2026-02-17T12:07:29.715 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.715 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.715 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.715 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.715 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.715 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.716 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.716 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.716 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.716 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.716 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe57a7fc640 4 set_mon_vals no callback set 2026-02-17T12:07:29.716 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe5823b6640 5 monclient: authenticate success, global_id 4466 2026-02-17T12:07:29.716 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe5823b6640 10 monclient: _renew_subs 2026-02-17T12:07:29.716 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe5823b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.716 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe5823b6640 1 -- 10.20.193.77:0/227341902 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe57c09f3a0 con 0x7fe57c06da30 2026-02-17T12:07:29.716 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe5823b6640 10 monclient: _renew_subs 2026-02-17T12:07:29.716 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe5823b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.716 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe5823b6640 1 -- 10.20.193.77:0/227341902 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe57c140290 con 0x7fe57c06da30 2026-02-17T12:07:29.717 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe5823b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:29.717 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe5823b6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:29.717 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe5823b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.717 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe5823b6640 1 -- 10.20.193.77:0/227341902 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe57c0a36e0 con 0x7fe57c06da30 2026-02-17T12:07:29.717 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 1 -- 10.20.193.77:0/227341902 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fe568024060 con 0x7fe57c06da30 2026-02-17T12:07:29.717 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 1 --2- 10.20.193.77:0/227341902 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe54c03a170 0x7fe54c03c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.717 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 1 -- 10.20.193.77:0/227341902 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7fe56804da00 con 0x7fe57c06da30 2026-02-17T12:07:29.717 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe57b7fe640 1 --2- 10.20.193.77:0/227341902 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe54c03a170 0x7fe54c03c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.717 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe57b7fe640 10 monclient: get_auth_request con 0x7fe54c03a170 auth_method 0 2026-02-17T12:07:29.717 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 1 -- 10.20.193.77:0/227341902 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7fe568013dc0 con 0x7fe57c06da30 2026-02-17T12:07:29.717 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:29.718 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.695+0000 7fe578ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:29.718 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.699+0000 7fe57b7fe640 1 --2- 10.20.193.77:0/227341902 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe54c03a170 0x7fe54c03c630 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe56c006fd0 tx=0x7fe56c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.776 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 1 -- 10.20.193.77:0/227341902 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fe57c0008e0 con 0x7fe54c03a170 2026-02-17T12:07:29.777 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe578ff9640 1 -- 10.20.193.77:0/227341902 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe57c0008e0 con 0x7fe54c03a170 2026-02-17T12:07:29.777 INFO:teuthology.orchestra.run.trial077.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T12:07:29.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 1 -- 10.20.193.77:0/227341902 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe54c03a170 msgr2=0x7fe54c03c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 1 --2- 10.20.193.77:0/227341902 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe54c03a170 0x7fe54c03c630 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe56c006fd0 tx=0x7fe56c008040 comp rx=0 tx=0).stop 2026-02-17T12:07:29.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 10 monclient: shutdown 2026-02-17T12:07:29.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:29.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 1 -- 10.20.193.77:0/227341902 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c06da30 msgr2=0x7fe57c1cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 1 --2- 10.20.193.77:0/227341902 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c06da30 0x7fe57c1cef50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe56800e9b0 tx=0x7fe56800ee70 comp rx=0 tx=0).stop 2026-02-17T12:07:29.778 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 1 -- 10.20.193.77:0/227341902 shutdown_connections 2026-02-17T12:07:29.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 1 --2- 10.20.193.77:0/227341902 >> v2:10.20.193.119:6800/4127986552 conn(0x7fe54c03a170 0x7fe54c03c630 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 1 --2- 10.20.193.77:0/227341902 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fe57c0a3c20 0x7fe57c1d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 1 --2- 10.20.193.77:0/227341902 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fe57c0a3300 0x7fe57c138890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 1 --2- 10.20.193.77:0/227341902 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fe57c06da30 0x7fe57c1cef50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 1 -- 10.20.193.77:0/227341902 >> 10.20.193.77:0/227341902 conn(0x7fe57c0a8900 msgr2=0x7fe57c072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:29.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 1 -- 10.20.193.77:0/227341902 shutdown_connections 2026-02-17T12:07:29.779 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.771+0000 7fe5823b6640 1 -- 10.20.193.77:0/227341902 wait complete. 2026-02-17T12:07:29.787 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T12:07:29.788 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:07:29.860 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 10 monclient: get_monmap_and_config 2026-02-17T12:07:29.860 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 10 monclient: build_initial_monmap 2026-02-17T12:07:29.860 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 10 monclient: monmap: 2026-02-17T12:07:29.860 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:29.860 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.860 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:29.858302+0000 2026-02-17T12:07:29.860 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:29.858302+0000 2026-02-17T12:07:29.861 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:29.861 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.861 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:29.861 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:29.861 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:29.861 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:29.861 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:29.861 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.861 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 1 Processor -- start 2026-02-17T12:07:29.861 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 1 -- start start 2026-02-17T12:07:29.861 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 10 monclient: init 2026-02-17T12:07:29.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:29.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-17T12:07:29.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f670c138000 addr v1:10.20.193.119:6789/0 2026-02-17T12:07:29.864 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f670c138a50 0x7f670c13d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 10 monclient(hunting): picked mon.noname-c con 0x7f670c138a50 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:29.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f670c09be20 addr v1:10.20.193.77:6789/0 2026-02-17T12:07:29.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f670c09cc80 con 0x7f670c09be20 2026-02-17T12:07:29.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f670c09cf60 con 0x7f670c138000 2026-02-17T12:07:29.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f670c1383e0 con 0x7f670c138a50 2026-02-17T12:07:29.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:29.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6712648640 10 monclient(hunting): authenticate will time out at 701.534141s 2026-02-17T12:07:29.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6710bbe640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f670c09be20 0x7f670c13f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:51638/0 (socket says 10.20.193.77:51638) 2026-02-17T12:07:29.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f6710bbe640 1 -- 10.20.193.77:0/83276685 learned_addr learned my addr 10.20.193.77:0/83276685 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:07:29.865 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f670b7fe640 1 --2- 10.20.193.77:0/83276685 >> v2:10.20.193.119:3300/0 conn(0x7f670c138a50 0x7f670c13d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f670b7fe640 10 monclient(hunting): get_auth_request con 0x7f670c138a50 auth_method 0 2026-02-17T12:07:29.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f670b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f670b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.855+0000 7f670b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f6710bbe640 1 -- 10.20.193.77:0/83276685 >> v1:10.20.193.77:6789/0 conn(0x7f670c09be20 legacy=0x7f670c13f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:29.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670bfff640 1 -- 10.20.193.77:0/83276685 >> v1:10.20.193.119:6789/0 conn(0x7f670c138000 legacy=0x7f670c0a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:29.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670affd640 1 -- 10.20.193.77:0/83276685 <== mon.0 v1:10.20.193.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3428785686 0 0) 0x7f670c09cc80 con 0x7f670c09be20 2026-02-17T12:07:29.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670affd640 10 monclient(hunting): _negotiate 2026-02-17T12:07:29.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.866 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670affd640 10 monclient(hunting): my global_id is 4485 2026-02-17T12:07:29.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670affd640 1 -- 10.20.193.77:0/83276685 --> v1:10.20.193.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66f0003630 con 0x7f670c09be20 2026-02-17T12:07:29.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670b7fe640 10 monclient(hunting): handle_auth_done global_id 14143 payload 274 2026-02-17T12:07:29.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670b7fe640 1 -- 10.20.193.77:0/83276685 >> v1:10.20.193.119:6789/0 conn(0x7f670c138000 legacy=0x7f670c0a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670b7fe640 1 -- 10.20.193.77:0/83276685 >> v1:10.20.193.77:6789/0 conn(0x7f670c09be20 legacy=0x7f670c13f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670b7fe640 10 monclient: _finish_hunting 0 2026-02-17T12:07:29.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670b7fe640 1 monclient: found mon.noname-c 2026-02-17T12:07:29.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:29.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.119:3300/0 2026-02-17T12:07:29.867 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.859+0000 7f670b7fe640 1 -- 10.20.193.77:0/83276685 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670c09d240 con 0x7f670c138a50 2026-02-17T12:07:29.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670b7fe640 1 -- 10.20.193.77:0/83276685 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f670c138a50 msgr2=0x7f670c13d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:29.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670b7fe640 1 --2- 10.20.193.77:0/83276685 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f670c138a50 0x7f670c13d320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0099c0 tx=0x7f66fc01c610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad402572e7b76b25 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670affd640 1 -- 10.20.193.77:0/83276685 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc0ab610 con 0x7f670c138a50 2026-02-17T12:07:29.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:29.874 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670affd640 10 monclient: dump: 2026-02-17T12:07:29.875 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.875 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.875 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.875 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.875 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.875 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.875 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.875 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.875 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.875 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670affd640 10 monclient: _finish_auth 0 2026-02-17T12:07:29.875 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670affd640 10 monclient: _check_auth_tickets 2026-02-17T12:07:29.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:29.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670affd640 1 -- 10.20.193.77:0/83276685 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc0b0070 con 0x7f670c138a50 2026-02-17T12:07:29.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670affd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:29.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 5 monclient: authenticate success, global_id 14143 2026-02-17T12:07:29.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670affd640 1 -- 10.20.193.77:0/83276685 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc0ab9d0 con 0x7f670c138a50 2026-02-17T12:07:29.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:29.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 4 set_mon_vals no callback set 2026-02-17T12:07:29.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:07:29.876 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670affd640 10 monclient: dump: 2026-02-17T12:07:29.876 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.876 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.877 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.877 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.877 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.877 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.877 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.877 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.877 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.877 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.877 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient: shutdown 2026-02-17T12:07:29.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:29.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 -- 10.20.193.77:0/83276685 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f670c138a50 msgr2=0x7f670c13d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 --2- 10.20.193.77:0/83276685 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f670c138a50 0x7f670c13d320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0099c0 tx=0x7f66fc01c610 comp rx=0 tx=0).stop 2026-02-17T12:07:29.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 -- 10.20.193.77:0/83276685 shutdown_connections 2026-02-17T12:07:29.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 --2- 10.20.193.77:0/83276685 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f670c138a50 0x7f670c13d320 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 -- 10.20.193.77:0/83276685 >> 10.20.193.77:0/83276685 conn(0x7f670c0aad40 msgr2=0x7f670c0ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:29.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 -- 10.20.193.77:0/83276685 shutdown_connections 2026-02-17T12:07:29.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 -- 10.20.193.77:0/83276685 wait complete. 2026-02-17T12:07:29.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient: build_initial_monmap 2026-02-17T12:07:29.878 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient: monmap: 2026-02-17T12:07:29.878 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:29.878 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:29.879 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:29.879 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:29.879 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:29.879 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.879 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:29.879 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:29.879 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:29.879 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.879 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 Processor -- start 2026-02-17T12:07:29.879 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 -- start start 2026-02-17T12:07:29.879 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient: init 2026-02-17T12:07:29.879 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:29.879 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:07:29.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f670c09be20 0x7f670c131780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient(hunting): picked mon.noname-b con 0x7f670c09be20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:29.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f670c138000 0x7f670c131cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient(hunting): picked mon.noname-a con 0x7f670c138000 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:29.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f670c138a50 0x7f670c0a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient(hunting): picked mon.noname-c con 0x7f670c138a50 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:29.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f670c143b40 con 0x7f670c138000 2026-02-17T12:07:29.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.880 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f670c1439c0 con 0x7f670c09be20 2026-02-17T12:07:29.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f670c143cc0 con 0x7f670c138a50 2026-02-17T12:07:29.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:29.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6712648640 10 monclient(hunting): authenticate will time out at 701.542596s 2026-02-17T12:07:29.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670b7fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f670c138000 0x7f670c131cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f670c138a50 0x7f670c0a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670b7fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f670c138000 0x7f670c131cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:54736/0 (socket says 10.20.193.77:54736) 2026-02-17T12:07:29.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670b7fe640 1 -- 10.20.193.77:0/1862141827 learned_addr learned my addr 10.20.193.77:0/1862141827 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:29.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670b7fe640 10 monclient(hunting): get_auth_request con 0x7f670c138000 auth_method 0 2026-02-17T12:07:29.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.881 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 10 monclient(hunting): get_auth_request con 0x7f670c138a50 auth_method 0 2026-02-17T12:07:29.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670bfff640 1 --2- 10.20.193.77:0/1862141827 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f670c09be20 0x7f670c131780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670bfff640 10 monclient(hunting): get_auth_request con 0x7f670c09be20 auth_method 0 2026-02-17T12:07:29.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.882 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 10 monclient(hunting): handle_auth_done global_id 4469 payload 824 2026-02-17T12:07:29.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 1 -- 10.20.193.77:0/1862141827 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f670c09be20 msgr2=0x7f670c131780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 1 --2- 10.20.193.77:0/1862141827 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f670c09be20 0x7f670c131780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 1 -- 10.20.193.77:0/1862141827 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f670c138000 msgr2=0x7f670c131cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.883 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 1 --2- 10.20.193.77:0/1862141827 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f670c138000 0x7f670c131cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 10 monclient: _finish_hunting 0 2026-02-17T12:07:29.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 1 monclient: found mon.noname-c 2026-02-17T12:07:29.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:29.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f6710bbe640 1 -- 10.20.193.77:0/1862141827 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670c1398f0 con 0x7f670c138a50 2026-02-17T12:07:29.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.863+0000 7f670b7fe640 1 --2- 10.20.193.77:0/1862141827 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f670c138000 0x7f670c131cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:29.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6710bbe640 1 -- 10.20.193.77:0/1862141827 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f670c138a50 msgr2=0x7f670c0a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:29.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6710bbe640 1 --2- 10.20.193.77:0/1862141827 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f670c138a50 0x7f670c0a1810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f670000cdc0 tx=0x7f670000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 1 -- 10.20.193.77:0/1862141827 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670000ad40 con 0x7f670c138a50 2026-02-17T12:07:29.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.884 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:29.885 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 10 monclient: dump: 2026-02-17T12:07:29.885 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.885 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.885 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.885 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.885 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.885 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.885 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.885 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.885 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.885 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.885 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 10 monclient: _finish_auth 0 2026-02-17T12:07:29.885 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 10 monclient: _check_auth_tickets 2026-02-17T12:07:29.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:29.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6712648640 5 monclient: authenticate success, global_id 4469 2026-02-17T12:07:29.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6712648640 10 monclient: _renew_subs 2026-02-17T12:07:29.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6712648640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6712648640 1 -- 10.20.193.77:0/1862141827 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f670c0aa890 con 0x7f670c138a50 2026-02-17T12:07:29.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 1 -- 10.20.193.77:0/1862141827 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6700012400 con 0x7f670c138a50 2026-02-17T12:07:29.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:29.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 1 -- 10.20.193.77:0/1862141827 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67000127f0 con 0x7f670c138a50 2026-02-17T12:07:29.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:29.886 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 10 monclient: dump: 2026-02-17T12:07:29.886 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.887 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.887 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.887 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.887 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.887 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.887 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.887 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.887 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.887 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.887 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f670a7fc640 4 set_mon_vals no callback set 2026-02-17T12:07:29.887 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6712648640 10 monclient: _renew_subs 2026-02-17T12:07:29.887 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6712648640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.887 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6712648640 1 -- 10.20.193.77:0/1862141827 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f670c139bd0 con 0x7f670c138a50 2026-02-17T12:07:29.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6712648640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6712648640 1 -- 10.20.193.77:0/1862141827 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f670c0a4ab0 con 0x7f670c138a50 2026-02-17T12:07:29.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 1 -- 10.20.193.77:0/1862141827 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f6700012a50 con 0x7f670c138a50 2026-02-17T12:07:29.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 1 --2- 10.20.193.77:0/1862141827 >> v2:10.20.193.119:6800/4127986552 conn(0x7f66dc03a150 0x7f66dc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 1 -- 10.20.193.77:0/1862141827 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f670004dd10 con 0x7f670c138a50 2026-02-17T12:07:29.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 1 --2- 10.20.193.77:0/1862141827 >> v2:10.20.193.77:6801/662135547 conn(0x7f66dc03fbf0 0x7f66dc042010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 1 -- 10.20.193.77:0/1862141827 --> v2:10.20.193.77:6801/662135547 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66dc042680 con 0x7f66dc03fbf0 2026-02-17T12:07:29.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 1 -- 10.20.193.77:0/1862141827 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f67000502e0 con 0x7f670c138a50 2026-02-17T12:07:29.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f6708ff9640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-17T12:07:29.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f670bfff640 1 --2- 10.20.193.77:0/1862141827 >> v2:10.20.193.119:6800/4127986552 conn(0x7f66dc03a150 0x7f66dc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.888 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f670bfff640 10 monclient: get_auth_request con 0x7f66dc03a150 auth_method 0 2026-02-17T12:07:29.889 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f670b7fe640 1 --2- 10.20.193.77:0/1862141827 >> v2:10.20.193.77:6801/662135547 conn(0x7f66dc03fbf0 0x7f66dc042010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.889 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.867+0000 7f670b7fe640 10 monclient: get_auth_request con 0x7f66dc03fbf0 auth_method 0 2026-02-17T12:07:29.890 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.871+0000 7f670bfff640 1 --2- 10.20.193.77:0/1862141827 >> v2:10.20.193.119:6800/4127986552 conn(0x7f66dc03a150 0x7f66dc03c610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f66f8002420 tx=0x7f66f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.890 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.871+0000 7f670b7fe640 1 --2- 10.20.193.77:0/1862141827 >> v2:10.20.193.77:6801/662135547 conn(0x7f66dc03fbf0 0x7f66dc042010 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.890 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.871+0000 7f6708ff9640 1 -- 10.20.193.77:0/1862141827 <== osd.1 v2:10.20.193.77:6801/662135547 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f66dc042680 con 0x7f66dc03fbf0 2026-02-17T12:07:29.890 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6712648640 1 -- 10.20.193.77:0/1862141827 --> v2:10.20.193.77:6801/662135547 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f670c06f620 con 0x7f66dc03fbf0 2026-02-17T12:07:29.890 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6708ff9640 1 -- 10.20.193.77:0/1862141827 <== osd.1 v2:10.20.193.77:6801/662135547 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f670c06f620 con 0x7f66dc03fbf0 2026-02-17T12:07:29.890 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T12:07:29.891 INFO:teuthology.orchestra.run.trial077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:07:29.891 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T12:07:29.892 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6712648640 1 -- 10.20.193.77:0/1862141827 >> v2:10.20.193.77:6801/662135547 conn(0x7f66dc03fbf0 msgr2=0x7f66dc042010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.892 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6712648640 1 --2- 10.20.193.77:0/1862141827 >> v2:10.20.193.77:6801/662135547 conn(0x7f66dc03fbf0 0x7f66dc042010 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.892 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6712648640 1 -- 10.20.193.77:0/1862141827 >> v2:10.20.193.119:6800/4127986552 conn(0x7f66dc03a150 msgr2=0x7f66dc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.892 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6712648640 1 --2- 10.20.193.77:0/1862141827 >> v2:10.20.193.119:6800/4127986552 conn(0x7f66dc03a150 0x7f66dc03c610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f66f8002420 tx=0x7f66f8009040 comp rx=0 tx=0).stop 2026-02-17T12:07:29.892 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6712648640 10 monclient: shutdown 2026-02-17T12:07:29.892 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6712648640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:29.892 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6712648640 1 -- 10.20.193.77:0/1862141827 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f670c138a50 msgr2=0x7f670c0a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.893 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6712648640 1 --2- 10.20.193.77:0/1862141827 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f670c138a50 0x7f670c0a1810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f670000cdc0 tx=0x7f670000a430 comp rx=0 tx=0).stop 2026-02-17T12:07:29.893 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6710bbe640 1 -- 10.20.193.77:0/1862141827 reap_dead start 2026-02-17T12:07:29.893 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6712648640 1 -- 10.20.193.77:0/1862141827 shutdown_connections 2026-02-17T12:07:29.893 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6712648640 1 -- 10.20.193.77:0/1862141827 >> 10.20.193.77:0/1862141827 conn(0x7f670c0aad40 msgr2=0x7f670c136ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:29.893 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6712648640 1 -- 10.20.193.77:0/1862141827 shutdown_connections 2026-02-17T12:07:29.893 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.879+0000 7f6712648640 1 -- 10.20.193.77:0/1862141827 wait complete. 2026-02-17T12:07:29.894 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T12:07:29.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 10 monclient: get_monmap_and_config 2026-02-17T12:07:29.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 10 monclient: build_initial_monmap 2026-02-17T12:07:29.955 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 10 monclient: monmap: 2026-02-17T12:07:29.955 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:29.955 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.955 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:29.953816+0000 2026-02-17T12:07:29.956 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:29.953816+0000 2026-02-17T12:07:29.956 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:29.956 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.956 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:29.956 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:29.956 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:29.956 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:29.956 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:29.956 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.958 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 1 Processor -- start 2026-02-17T12:07:29.958 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 1 -- start start 2026-02-17T12:07:29.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 10 monclient: init 2026-02-17T12:07:29.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:29.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 10 monclient: _add_conns ranks=[0,1,2,3,4] 2026-02-17T12:07:29.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc37009be20 addr v1:10.20.193.77:6789/0 2026-02-17T12:07:29.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc3700a4c20 addr v1:10.20.193.119:6789/0 2026-02-17T12:07:29.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc3700a5070 0x7fc370140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 10 monclient(hunting): picked mon.noname-b con 0x7fc3700a5070 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:29.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc370135530 con 0x7fc37009be20 2026-02-17T12:07:29.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc37009cdf0 con 0x7fc3700a4c20 2026-02-17T12:07:29.959 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc37009c200 con 0x7fc3700a5070 2026-02-17T12:07:29.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:29.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc377b94640 10 monclient(hunting): authenticate will time out at 701.629279s 2026-02-17T12:07:29.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc375909640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7fc37009be20 0x7fc370134e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:51652/0 (socket says 10.20.193.77:51652) 2026-02-17T12:07:29.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc375909640 1 -- 10.20.193.77:0/291358192 learned_addr learned my addr 10.20.193.77:0/291358192 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:07:29.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 1 --2- 10.20.193.77:0/291358192 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc3700a5070 0x7fc370140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 10 monclient(hunting): get_auth_request con 0x7fc3700a5070 auth_method 0 2026-02-17T12:07:29.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.960 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.961 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.961 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.961 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.961 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 10 monclient(hunting): handle_auth_done global_id 4472 payload 274 2026-02-17T12:07:29.961 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 1 -- 10.20.193.77:0/291358192 >> v1:10.20.193.119:6789/0 conn(0x7fc3700a4c20 legacy=0x7fc37013d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:29.961 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 1 -- 10.20.193.77:0/291358192 >> v1:10.20.193.77:6789/0 conn(0x7fc37009be20 legacy=0x7fc370134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:29.961 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 10 monclient: _finish_hunting 0 2026-02-17T12:07:29.961 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 1 monclient: found mon.noname-b 2026-02-17T12:07:29.961 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:29.961 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.961 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.951+0000 7fc37610a640 1 -- 10.20.193.77:0/291358192 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37009d0d0 con 0x7fc3700a5070 2026-02-17T12:07:29.968 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc37610a640 1 -- 10.20.193.77:0/291358192 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc3700a5070 msgr2=0x7fc370140ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:29.968 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc37610a640 1 --2- 10.20.193.77:0/291358192 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc3700a5070 0x7fc370140ba0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009dc0 tx=0x7fc36c01c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79ae4f025ed2e348 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.969 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc374907640 1 -- 10.20.193.77:0/291358192 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c0b2070 con 0x7fc3700a5070 2026-02-17T12:07:29.969 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc374907640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.969 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc374907640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:29.969 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc374907640 10 monclient: dump: 2026-02-17T12:07:29.969 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.969 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.969 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.969 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.969 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.969 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.969 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.970 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.970 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.970 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.970 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc374907640 10 monclient: _finish_auth 0 2026-02-17T12:07:29.970 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc374907640 10 monclient: _check_auth_tickets 2026-02-17T12:07:29.970 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc374907640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:29.970 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc374907640 1 -- 10.20.193.77:0/291358192 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36c0a5840 con 0x7fc3700a5070 2026-02-17T12:07:29.970 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc374907640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:29.970 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc374907640 1 -- 10.20.193.77:0/291358192 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c0a5c10 con 0x7fc3700a5070 2026-02-17T12:07:29.970 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc374907640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.970 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc374907640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:29.970 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc374907640 10 monclient: dump: 2026-02-17T12:07:29.971 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.971 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.971 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.971 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.971 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.971 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.971 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.971 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.971 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.971 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.971 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 5 monclient: authenticate success, global_id 4472 2026-02-17T12:07:29.971 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:29.972 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 4 set_mon_vals no callback set 2026-02-17T12:07:29.972 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient: shutdown 2026-02-17T12:07:29.972 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:29.972 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 -- 10.20.193.77:0/291358192 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc3700a5070 msgr2=0x7fc370140ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.972 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 --2- 10.20.193.77:0/291358192 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc3700a5070 0x7fc370140ba0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009dc0 tx=0x7fc36c01c810 comp rx=0 tx=0).stop 2026-02-17T12:07:29.972 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 -- 10.20.193.77:0/291358192 shutdown_connections 2026-02-17T12:07:29.972 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 --2- 10.20.193.77:0/291358192 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc3700a5070 0x7fc370140ba0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.972 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 -- 10.20.193.77:0/291358192 >> 10.20.193.77:0/291358192 conn(0x7fc370074ba0 msgr2=0x7fc3700aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:29.972 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 -- 10.20.193.77:0/291358192 shutdown_connections 2026-02-17T12:07:29.972 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 -- 10.20.193.77:0/291358192 wait complete. 2026-02-17T12:07:29.972 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient: build_initial_monmap 2026-02-17T12:07:29.972 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient: monmap: 2026-02-17T12:07:29.972 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:29.973 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:29.973 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:29.973 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:29.973 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:29.973 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.973 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:29.973 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:29.973 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:29.973 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 Processor -- start 2026-02-17T12:07:29.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 -- start start 2026-02-17T12:07:29.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient: init 2026-02-17T12:07:29.973 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:29.974 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T12:07:29.974 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc37009be20 0x7fc3700a2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.974 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient(hunting): picked mon.noname-c con 0x7fc37009be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:29.974 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc3700a4c20 0x7fc3700a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.974 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient(hunting): picked mon.noname-a con 0x7fc3700a4c20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:29.974 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc3700a5070 0x7fc3700a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.974 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient(hunting): picked mon.noname-b con 0x7fc3700a5070 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:29.974 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.974 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc370143c90 con 0x7fc3700a4c20 2026-02-17T12:07:29.974 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.974 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc370143b10 con 0x7fc3700a5070 2026-02-17T12:07:29.974 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:29.974 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc370143e10 con 0x7fc37009be20 2026-02-17T12:07:29.975 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:29.975 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc377b94640 10 monclient(hunting): authenticate will time out at 701.634583s 2026-02-17T12:07:29.975 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc37009be20 0x7fc3700a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.975 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc37009be20 0x7fc3700a2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:59428/0 (socket says 10.20.193.77:59428) 2026-02-17T12:07:29.975 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 1 -- 10.20.193.77:0/1588868294 learned_addr learned my addr 10.20.193.77:0/1588868294 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:29.975 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 10 monclient(hunting): get_auth_request con 0x7fc37009be20 auth_method 0 2026-02-17T12:07:29.975 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.975 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.975 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.975 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375108640 1 --2- 10.20.193.77:0/1588868294 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc3700a4c20 0x7fc3700a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.975 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.976 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.976 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.976 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375108640 10 monclient(hunting): get_auth_request con 0x7fc3700a4c20 auth_method 0 2026-02-17T12:07:29.976 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375108640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:29.976 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375108640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:29.976 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375108640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:29.976 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375108640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:29.976 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375108640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:29.976 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375108640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:29.976 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc37610a640 1 --2- 10.20.193.77:0/1588868294 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc3700a5070 0x7fc3700a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.976 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 10 monclient(hunting): handle_auth_done global_id 4475 payload 824 2026-02-17T12:07:29.976 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 1 -- 10.20.193.77:0/1588868294 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc3700a5070 msgr2=0x7fc3700a32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.976 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 1 --2- 10.20.193.77:0/1588868294 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc3700a5070 0x7fc3700a32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.977 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 1 -- 10.20.193.77:0/1588868294 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc3700a4c20 msgr2=0x7fc3700a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:29.977 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 1 --2- 10.20.193.77:0/1588868294 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc3700a4c20 0x7fc3700a2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:29.977 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 10 monclient: _finish_hunting 0 2026-02-17T12:07:29.977 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 1 monclient: found mon.noname-c 2026-02-17T12:07:29.977 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:29.977 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.977 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc375909640 1 -- 10.20.193.77:0/1588868294 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37013ab10 con 0x7fc37009be20 2026-02-17T12:07:29.977 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc37610a640 10 monclient: get_auth_request con 0x7fc3700a5070 auth_method 0 2026-02-17T12:07:29.977 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.955+0000 7fc37610a640 1 --2- 10.20.193.77:0/1588868294 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc3700a5070 0x7fc3700a32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:07:29.977 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc375909640 1 -- 10.20.193.77:0/1588868294 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc37009be20 msgr2=0x7fc3700a2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:29.977 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc375909640 1 --2- 10.20.193.77:0/1588868294 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc37009be20 0x7fc3700a2830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc36000c5a0 tx=0x7fc36000ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.978 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 1 -- 10.20.193.77:0/1588868294 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360017070 con 0x7fc37009be20 2026-02-17T12:07:29.978 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.978 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:29.978 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 10 monclient: dump: 2026-02-17T12:07:29.978 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.978 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.978 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.978 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.978 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.978 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.978 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.978 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.979 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.979 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 10 monclient: _finish_auth 0 2026-02-17T12:07:29.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:07:29.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:29.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 1 -- 10.20.193.77:0/1588868294 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc360007070 con 0x7fc37009be20 2026-02-17T12:07:29.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:29.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 1 -- 10.20.193.77:0/1588868294 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360007460 con 0x7fc37009be20 2026-02-17T12:07:29.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc377b94640 5 monclient: authenticate success, global_id 4475 2026-02-17T12:07:29.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc377b94640 10 monclient: _renew_subs 2026-02-17T12:07:29.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35ffff640 4 set_mon_vals no callback set 2026-02-17T12:07:29.979 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc377b94640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc377b94640 1 -- 10.20.193.77:0/1588868294 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37013adf0 con 0x7fc37009be20 2026-02-17T12:07:29.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:29.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:29.980 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 10 monclient: dump: 2026-02-17T12:07:29.980 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:29.980 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:29.980 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.980 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:29.980 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:29.980 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:29.980 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:29.980 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:29.981 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:29.981 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:29.981 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc377b94640 10 monclient: _renew_subs 2026-02-17T12:07:29.981 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc377b94640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.981 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc377b94640 1 -- 10.20.193.77:0/1588868294 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc370139660 con 0x7fc37009be20 2026-02-17T12:07:29.981 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc377b94640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:29.981 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc377b94640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:29.981 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc377b94640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:29.981 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc377b94640 1 -- 10.20.193.77:0/1588868294 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc370134e00 con 0x7fc37009be20 2026-02-17T12:07:29.981 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 1 -- 10.20.193.77:0/1588868294 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fc360007600 con 0x7fc37009be20 2026-02-17T12:07:29.981 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 1 --2- 10.20.193.77:0/1588868294 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc34003a170 0x7fc34003c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:29.982 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc35e7fc640 1 -- 10.20.193.77:0/1588868294 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7fc36004d0c0 con 0x7fc37009be20 2026-02-17T12:07:29.982 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc375108640 1 --2- 10.20.193.77:0/1588868294 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc34003a170 0x7fc34003c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:29.982 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.959+0000 7fc375108640 10 monclient: get_auth_request con 0x7fc34003a170 auth_method 0 2026-02-17T12:07:29.982 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.963+0000 7fc375108640 1 --2- 10.20.193.77:0/1588868294 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc34003a170 0x7fc34003c630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc3700a4b80 tx=0x7fc364007f40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:29.982 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.963+0000 7fc35e7fc640 1 -- 10.20.193.77:0/1588868294 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7fc36001bd50 con 0x7fc37009be20 2026-02-17T12:07:29.982 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.963+0000 7fc35e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:29.982 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:29.963+0000 7fc35e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:30.042 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.035+0000 7fc377b94640 1 -- 10.20.193.77:0/1588868294 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fc370140cd0 con 0x7fc34003a170 2026-02-17T12:07:30.042 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.035+0000 7fc35e7fc640 1 -- 10.20.193.77:0/1588868294 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc370140cd0 con 0x7fc34003a170 2026-02-17T12:07:30.042 INFO:teuthology.orchestra.run.trial077.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T12:07:30.043 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.039+0000 7fc377b94640 1 -- 10.20.193.77:0/1588868294 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc34003a170 msgr2=0x7fc34003c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.043 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.039+0000 7fc377b94640 1 --2- 10.20.193.77:0/1588868294 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc34003a170 0x7fc34003c630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc3700a4b80 tx=0x7fc364007f40 comp rx=0 tx=0).stop 2026-02-17T12:07:30.044 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.039+0000 7fc377b94640 10 monclient: shutdown 2026-02-17T12:07:30.044 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.039+0000 7fc377b94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:30.044 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.039+0000 7fc377b94640 1 -- 10.20.193.77:0/1588868294 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc37009be20 msgr2=0x7fc3700a2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.044 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.039+0000 7fc377b94640 1 --2- 10.20.193.77:0/1588868294 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc37009be20 0x7fc3700a2830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc36000c5a0 tx=0x7fc36000ca60 comp rx=0 tx=0).stop 2026-02-17T12:07:30.044 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.039+0000 7fc377b94640 1 -- 10.20.193.77:0/1588868294 shutdown_connections 2026-02-17T12:07:30.044 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.039+0000 7fc377b94640 1 --2- 10.20.193.77:0/1588868294 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc34003a170 0x7fc34003c630 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.044 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.039+0000 7fc377b94640 1 --2- 10.20.193.77:0/1588868294 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc3700a5070 0x7fc3700a32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.044 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.039+0000 7fc377b94640 1 --2- 10.20.193.77:0/1588868294 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc3700a4c20 0x7fc3700a2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.044 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.039+0000 7fc377b94640 1 --2- 10.20.193.77:0/1588868294 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc37009be20 0x7fc3700a2830 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.044 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.039+0000 7fc377b94640 1 -- 10.20.193.77:0/1588868294 >> 10.20.193.77:0/1588868294 conn(0x7fc370074ba0 msgr2=0x7fc3700aa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:30.044 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.039+0000 7fc377b94640 1 -- 10.20.193.77:0/1588868294 shutdown_connections 2026-02-17T12:07:30.045 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.039+0000 7fc377b94640 1 -- 10.20.193.77:0/1588868294 wait complete. 2026-02-17T12:07:30.053 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T12:07:30.053 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:07:30.118 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.111+0000 7fc84546b640 10 monclient: get_monmap_and_config 2026-02-17T12:07:30.118 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.111+0000 7fc84546b640 10 monclient: build_initial_monmap 2026-02-17T12:07:30.119 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.111+0000 7fc84546b640 10 monclient: monmap: 2026-02-17T12:07:30.119 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:30.119 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.119 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:30.116708+0000 2026-02-17T12:07:30.119 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:30.116708+0000 2026-02-17T12:07:30.119 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:30.119 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.119 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:30.119 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:30.119 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:30.119 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:30.119 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:30.120 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.111+0000 7fc84546b640 1 Processor -- start 2026-02-17T12:07:30.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.111+0000 7fc84546b640 1 -- start start 2026-02-17T12:07:30.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.111+0000 7fc84546b640 10 monclient: init 2026-02-17T12:07:30.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc84546b640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.126 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc84546b640 10 monclient: _add_conns ranks=[2,1,3,4,0] 2026-02-17T12:07:30.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc84546b640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 0x7fc840137f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc84546b640 10 monclient(hunting): picked mon.noname-b con 0x7fc8400a3ea0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:30.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc84546b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc840073c30 addr v1:10.20.193.119:6789/0 2026-02-17T12:07:30.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc84546b640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fc840074010 0x7fc8400a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc84546b640 10 monclient(hunting): picked mon.noname-a con 0x7fc840074010 addr v2:10.20.193.77:3300/0 2026-02-17T12:07:30.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc84546b640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc840070190 con 0x7fc840073c30 2026-02-17T12:07:30.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc84546b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc84546b640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc8400a4280 con 0x7fc840074010 2026-02-17T12:07:30.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc84546b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.127 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc84546b640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc840070400 con 0x7fc8400a3ea0 2026-02-17T12:07:30.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc84546b640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc84546b640 10 monclient(hunting): authenticate will time out at 701.792436s 2026-02-17T12:07:30.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 0x7fc840137f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 0x7fc840137f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:59442/0 (socket says 10.20.193.77:59442) 2026-02-17T12:07:30.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 1 -- 10.20.193.77:0/3775969067 learned_addr learned my addr 10.20.193.77:0/3775969067 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:30.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 10 monclient(hunting): get_auth_request con 0x7fc8400a3ea0 auth_method 0 2026-02-17T12:07:30.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83f7fe640 1 --2- 10.20.193.77:0/3775969067 >> v2:10.20.193.77:3300/0 conn(0x7fc840074010 0x7fc8400a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83f7fe640 10 monclient(hunting): get_auth_request con 0x7fc840074010 auth_method 0 2026-02-17T12:07:30.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 10 monclient(hunting): handle_auth_done global_id 4478 payload 274 2026-02-17T12:07:30.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 1 -- 10.20.193.77:0/3775969067 >> v2:10.20.193.77:3300/0 conn(0x7fc840074010 msgr2=0x7fc8400a62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:30.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 1 --2- 10.20.193.77:0/3775969067 >> v2:10.20.193.77:3300/0 conn(0x7fc840074010 0x7fc8400a62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.129 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 1 -- 10.20.193.77:0/3775969067 >> v1:10.20.193.119:6789/0 conn(0x7fc840073c30 legacy=0x7fc8400a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:30.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 1 monclient: found mon.noname-b 2026-02-17T12:07:30.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 1 -- 10.20.193.77:0/3775969067 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc840074460 con 0x7fc8400a3ea0 2026-02-17T12:07:30.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 1 -- 10.20.193.77:0/3775969067 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 msgr2=0x7fc840137f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.115+0000 7fc83effd640 1 --2- 10.20.193.77:0/3775969067 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 0x7fc840137f10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc834009970 tx=0x7fc83401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=279b4611e7be2321 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83dffb640 1 -- 10.20.193.77:0/3775969067 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8340b1070 con 0x7fc8400a3ea0 2026-02-17T12:07:30.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:30.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83dffb640 10 monclient: dump: 2026-02-17T12:07:30.131 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.131 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.131 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.131 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.131 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.131 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.131 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.131 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.131 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.131 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83dffb640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83dffb640 1 -- 10.20.193.77:0/3775969067 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc834004230 con 0x7fc8400a3ea0 2026-02-17T12:07:30.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83dffb640 1 -- 10.20.193.77:0/3775969067 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8340a8050 con 0x7fc8400a3ea0 2026-02-17T12:07:30.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 5 monclient: authenticate success, global_id 4478 2026-02-17T12:07:30.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:30.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 4 set_mon_vals no callback set 2026-02-17T12:07:30.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:30.132 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83dffb640 10 monclient: dump: 2026-02-17T12:07:30.132 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.132 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.133 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.133 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.133 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.133 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.133 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.133 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.133 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.133 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.133 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient: shutdown 2026-02-17T12:07:30.133 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:30.133 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 -- 10.20.193.77:0/3775969067 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 msgr2=0x7fc840137f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.133 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 --2- 10.20.193.77:0/3775969067 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 0x7fc840137f10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc834009970 tx=0x7fc83401c540 comp rx=0 tx=0).stop 2026-02-17T12:07:30.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 -- 10.20.193.77:0/3775969067 shutdown_connections 2026-02-17T12:07:30.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 --2- 10.20.193.77:0/3775969067 >> v2:10.20.193.77:3300/0 conn(0x7fc840074010 0x7fc8400a62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 --2- 10.20.193.77:0/3775969067 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 0x7fc840137f10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 -- 10.20.193.77:0/3775969067 >> 10.20.193.77:0/3775969067 conn(0x7fc8400a7290 msgr2=0x7fc8400a3790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:30.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 -- 10.20.193.77:0/3775969067 shutdown_connections 2026-02-17T12:07:30.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 -- 10.20.193.77:0/3775969067 wait complete. 2026-02-17T12:07:30.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient: build_initial_monmap 2026-02-17T12:07:30.134 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient: monmap: 2026-02-17T12:07:30.134 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:30.134 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:30.134 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:30.134 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:30.134 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:30.135 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.135 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:30.135 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:30.135 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:30.135 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.135 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 Processor -- start 2026-02-17T12:07:30.135 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 -- start start 2026-02-17T12:07:30.135 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient: init 2026-02-17T12:07:30.135 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.135 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:07:30.135 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc840073c30 0x7fc8401d2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.135 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient(hunting): picked mon.noname-a con 0x7fc840073c30 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:30.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc840074010 0x7fc8401d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient(hunting): picked mon.noname-b con 0x7fc840074010 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:30.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 0x7fc840139060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient(hunting): picked mon.noname-c con 0x7fc8400a3ea0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:30.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc840142ad0 con 0x7fc840073c30 2026-02-17T12:07:30.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc8400a6a00 con 0x7fc840074010 2026-02-17T12:07:30.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc840142c50 con 0x7fc8400a3ea0 2026-02-17T12:07:30.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.136 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc84546b640 10 monclient(hunting): authenticate will time out at 701.797797s 2026-02-17T12:07:30.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc840073c30 0x7fc8401d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83f7fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 0x7fc840139060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc840073c30 0x7fc8401d2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:54758/0 (socket says 10.20.193.77:54758) 2026-02-17T12:07:30.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 1 -- 10.20.193.77:0/2533551296 learned_addr learned my addr 10.20.193.77:0/2533551296 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:30.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 10 monclient(hunting): get_auth_request con 0x7fc840073c30 auth_method 0 2026-02-17T12:07:30.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83f7fe640 10 monclient(hunting): get_auth_request con 0x7fc8400a3ea0 auth_method 0 2026-02-17T12:07:30.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.137 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83e7fc640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc840074010 0x7fc8401d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83e7fc640 10 monclient(hunting): get_auth_request con 0x7fc840074010 auth_method 0 2026-02-17T12:07:30.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 10 monclient(hunting): handle_auth_done global_id 4497 payload 824 2026-02-17T12:07:30.138 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 1 -- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 msgr2=0x7fc840139060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 0x7fc840139060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 1 -- 10.20.193.77:0/2533551296 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc840074010 msgr2=0x7fc8401d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc840074010 0x7fc8401d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 1 monclient: found mon.noname-a 2026-02-17T12:07:30.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:30.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83effd640 1 -- 10.20.193.77:0/2533551296 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84013fe30 con 0x7fc840073c30 2026-02-17T12:07:30.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.119+0000 7fc83f7fe640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 0x7fc840139060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:30.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 -- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc840073c30 msgr2=0x7fc8401d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.139 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc840073c30 0x7fc8401d2520 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc8340af040 tx=0x7fc8340192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8340b1050 con 0x7fc840073c30 2026-02-17T12:07:30.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:30.145 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: dump: 2026-02-17T12:07:30.145 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.146 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.146 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.146 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.146 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.146 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.146 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.146 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.146 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.146 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.146 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.146 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8340bd070 con 0x7fc840073c30 2026-02-17T12:07:30.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8340a8040 con 0x7fc840073c30 2026-02-17T12:07:30.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:30.147 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: dump: 2026-02-17T12:07:30.147 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.147 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.147 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.147 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.147 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.148 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.148 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.148 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.148 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.148 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83d7fa640 4 set_mon_vals no callback set 2026-02-17T12:07:30.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc84546b640 5 monclient: authenticate success, global_id 4497 2026-02-17T12:07:30.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc84546b640 10 monclient: _renew_subs 2026-02-17T12:07:30.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc84546b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:30.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc84546b640 1 -- 10.20.193.77:0/2533551296 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84013bf70 con 0x7fc840073c30 2026-02-17T12:07:30.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc84546b640 10 monclient: _renew_subs 2026-02-17T12:07:30.148 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc84546b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:30.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc84546b640 1 -- 10.20.193.77:0/2533551296 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc84013aca0 con 0x7fc840073c30 2026-02-17T12:07:30.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 -- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc840073c30 msgr2=0x7fc8401d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T12:07:30.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 -- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc840073c30 msgr2=0x7fc8401d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:07:30.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc840073c30 0x7fc8401d2520 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc8340af040 tx=0x7fc8340192e0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:30.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc840073c30 0x7fc8401d2520 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc8340af040 tx=0x7fc8340192e0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: ms_handle_reset current mon [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:30.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc840073c30 msgr2=0x7fc8401d2520 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T12:07:30.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc840073c30 0x7fc8401d2520 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T12:07:30.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 0x7fc80c0059d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.149 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient(hunting): picked mon.c con 0x7fc8400a3ea0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:30.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc840074010 0x7fc80c008410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient(hunting): picked mon.b con 0x7fc840074010 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:30.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc80c008e20 0x7fc80c00b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient(hunting): picked mon.a con 0x7fc80c008e20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:30.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c00bd60 con 0x7fc80c008e20 2026-02-17T12:07:30.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c00bee0 con 0x7fc840074010 2026-02-17T12:07:30.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc80c00c060 con 0x7fc8400a3ea0 2026-02-17T12:07:30.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 0x7fc80c0059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 10 monclient(hunting): get_auth_request con 0x7fc8400a3ea0 auth_method 0 2026-02-17T12:07:30.150 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:30.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83f7fe640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc80c008e20 0x7fc80c00b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83f7fe640 10 monclient(hunting): get_auth_request con 0x7fc80c008e20 auth_method 0 2026-02-17T12:07:30.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:30.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:07:30.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83e7fc640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc840074010 0x7fc80c008410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83e7fc640 10 monclient(hunting): get_auth_request con 0x7fc840074010 auth_method 0 2026-02-17T12:07:30.151 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83e7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 10 monclient(hunting): handle_auth_done global_id 4497 payload 293 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 -- 10.20.193.77:0/2533551296 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc840074010 msgr2=0x7fc80c008410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fc840074010 0x7fc80c008410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 -- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc80c008e20 msgr2=0x7fc80c00b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fc80c008e20 0x7fc80c00b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 monclient: found mon.c 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.152 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 -- 10.20.193.77:0/2533551296 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7fc80c00c390 con 0x7fc8400a3ea0 2026-02-17T12:07:30.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 -- 10.20.193.77:0/2533551296 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc840137f10 con 0x7fc8400a3ea0 2026-02-17T12:07:30.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 -- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 msgr2=0x7fc80c0059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83effd640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 0x7fc80c0059d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc83401c370 tx=0x7fc8340a7000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_get_version(what=osdmap handle=2) -- 0x7fc80c00c6e0 con 0x7fc8400a3ea0 2026-02-17T12:07:30.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834003030 con 0x7fc8400a3ea0 2026-02-17T12:07:30.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:30.153 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: dump: 2026-02-17T12:07:30.153 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80c00c6e0 con 0x7fc8400a3ea0 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc83cff9640 4 set_mon_vals no callback set 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.123+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fc8340031d0 con 0x7fc8400a3ea0 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.127+0000 7fc81f7fe640 1 --2- 10.20.193.77:0/2533551296 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc840073c30 0x7fc80c044990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.154 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.127+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 <== mon.2 v2:10.20.193.77:3301/0 4 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7fc8340ecba0 con 0x7fc8400a3ea0 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.127+0000 7fc81f7fe640 1 --2- 10.20.193.77:0/2533551296 >> v2:10.20.193.77:6808/3812083705 conn(0x7fc80c047eb0 0x7fc80c04a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.127+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 --> v2:10.20.193.77:6808/3812083705 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc834006920 con 0x7fc80c047eb0 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.127+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 <== mon.2 v2:10.20.193.77:3301/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc8340ecda0 con 0x7fc8400a3ea0 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.127+0000 7fc81f7fe640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.127+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_get_version_reply(handle=2 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc8340ecf40 con 0x7fc8400a3ea0 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.127+0000 7fc81f7fe640 10 monclient: handle_get_version_reply finishing 2 version 29 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.127+0000 7fc83e7fc640 1 --2- 10.20.193.77:0/2533551296 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc840073c30 0x7fc80c044990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.127+0000 7fc83f7fe640 1 --2- 10.20.193.77:0/2533551296 >> v2:10.20.193.77:6808/3812083705 conn(0x7fc80c047eb0 0x7fc80c04a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.127+0000 7fc83f7fe640 10 monclient: get_auth_request con 0x7fc80c047eb0 auth_method 0 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.127+0000 7fc83e7fc640 10 monclient: get_auth_request con 0x7fc840073c30 auth_method 0 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.127+0000 7fc83e7fc640 1 --2- 10.20.193.77:0/2533551296 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc840073c30 0x7fc80c044990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc84013c180 tx=0x7fc828009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.131+0000 7fc83f7fe640 1 --2- 10.20.193.77:0/2533551296 >> v2:10.20.193.77:6808/3812083705 conn(0x7fc80c047eb0 0x7fc80c04a2d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.131+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 <== osd.2 v2:10.20.193.77:6808/3812083705 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fc834006920 con 0x7fc80c047eb0 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc84546b640 1 -- 10.20.193.77:0/2533551296 --> v2:10.20.193.77:6808/3812083705 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc8401354a0 con 0x7fc80c047eb0 2026-02-17T12:07:30.155 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc81f7fe640 1 -- 10.20.193.77:0/2533551296 <== osd.2 v2:10.20.193.77:6808/3812083705 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc8401354a0 con 0x7fc80c047eb0 2026-02-17T12:07:30.156 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T12:07:30.156 INFO:teuthology.orchestra.run.trial077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:07:30.156 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T12:07:30.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc84546b640 1 -- 10.20.193.77:0/2533551296 >> v2:10.20.193.77:6808/3812083705 conn(0x7fc80c047eb0 msgr2=0x7fc80c04a2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.157 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc84546b640 1 --2- 10.20.193.77:0/2533551296 >> v2:10.20.193.77:6808/3812083705 conn(0x7fc80c047eb0 0x7fc80c04a2d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc84546b640 1 -- 10.20.193.77:0/2533551296 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc840073c30 msgr2=0x7fc80c044990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc84546b640 1 --2- 10.20.193.77:0/2533551296 >> v2:10.20.193.119:6800/4127986552 conn(0x7fc840073c30 0x7fc80c044990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc84013c180 tx=0x7fc828009040 comp rx=0 tx=0).stop 2026-02-17T12:07:30.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc84546b640 10 monclient: shutdown 2026-02-17T12:07:30.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc84546b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:30.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc84546b640 1 -- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 msgr2=0x7fc80c0059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc84546b640 1 --2- 10.20.193.77:0/2533551296 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fc8400a3ea0 0x7fc80c0059d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc83401c370 tx=0x7fc8340a7000 comp rx=0 tx=0).stop 2026-02-17T12:07:30.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc83f7fe640 1 -- 10.20.193.77:0/2533551296 reap_dead start 2026-02-17T12:07:30.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc84546b640 1 -- 10.20.193.77:0/2533551296 shutdown_connections 2026-02-17T12:07:30.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc84546b640 1 -- 10.20.193.77:0/2533551296 >> 10.20.193.77:0/2533551296 conn(0x7fc8400a7290 msgr2=0x7fc840073120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:30.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc84546b640 1 -- 10.20.193.77:0/2533551296 shutdown_connections 2026-02-17T12:07:30.158 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.135+0000 7fc84546b640 1 -- 10.20.193.77:0/2533551296 wait complete. 2026-02-17T12:07:30.159 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T12:07:30.221 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 10 monclient: get_monmap_and_config 2026-02-17T12:07:30.221 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 10 monclient: build_initial_monmap 2026-02-17T12:07:30.222 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 10 monclient: monmap: 2026-02-17T12:07:30.222 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:30.222 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.222 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:30.220163+0000 2026-02-17T12:07:30.222 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:30.220163+0000 2026-02-17T12:07:30.222 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:30.222 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.222 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:30.222 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:30.222 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:30.223 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:30.223 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:30.223 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.225 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 1 Processor -- start 2026-02-17T12:07:30.225 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 1 -- start start 2026-02-17T12:07:30.225 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 10 monclient: init 2026-02-17T12:07:30.225 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.225 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 10 monclient: _add_conns ranks=[1,0,2,3,4] 2026-02-17T12:07:30.225 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f29cc09be20 addr v1:10.20.193.119:6789/0 2026-02-17T12:07:30.225 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f29cc0a4c20 addr v1:10.20.193.77:6789/0 2026-02-17T12:07:30.225 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f29cc0a5070 0x7f29cc140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.225 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 10 monclient(hunting): picked mon.noname-b con 0x7f29cc0a5070 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:30.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29cc135530 con 0x7f29cc0a4c20 2026-02-17T12:07:30.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29cc09cdf0 con 0x7f29cc09be20 2026-02-17T12:07:30.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f29cc09c200 con 0x7f29cc0a5070 2026-02-17T12:07:30.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d388c640 10 monclient(hunting): authenticate will time out at 701.895825s 2026-02-17T12:07:30.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d0e00640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f29cc0a4c20 0x7f29cc13d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:51664/0 (socket says 10.20.193.77:51664) 2026-02-17T12:07:30.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d0e00640 1 -- 10.20.193.77:0/3126687454 learned_addr learned my addr 10.20.193.77:0/3126687454 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:07:30.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d1e02640 1 --2- 10.20.193.77:0/3126687454 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f29cc0a5070 0x7f29cc140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d1e02640 10 monclient(hunting): get_auth_request con 0x7f29cc0a5070 auth_method 0 2026-02-17T12:07:30.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d1e02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d1e02640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.215+0000 7f29d1e02640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.219+0000 7f29d1e02640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.219+0000 7f29d1e02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.219+0000 7f29d1e02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.219+0000 7f29d1e02640 10 monclient(hunting): handle_auth_done global_id 4484 payload 274 2026-02-17T12:07:30.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.219+0000 7f29d1e02640 1 -- 10.20.193.77:0/3126687454 >> v1:10.20.193.119:6789/0 conn(0x7f29cc09be20 legacy=0x7f29cc134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:30.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.219+0000 7f29d1e02640 1 -- 10.20.193.77:0/3126687454 >> v1:10.20.193.77:6789/0 conn(0x7f29cc0a4c20 legacy=0x7f29cc13d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:30.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.219+0000 7f29d1e02640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.219+0000 7f29d1e02640 1 monclient: found mon.noname-b 2026-02-17T12:07:30.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.219+0000 7f29d1e02640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.219+0000 7f29d1e02640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.219+0000 7f29d1e02640 1 -- 10.20.193.77:0/3126687454 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29cc09d0d0 con 0x7f29cc0a5070 2026-02-17T12:07:30.232 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1e02640 1 -- 10.20.193.77:0/3126687454 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f29cc0a5070 msgr2=0x7f29cc140ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.232 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1e02640 1 --2- 10.20.193.77:0/3126687454 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f29cc0a5070 0x7f29cc140ba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009dc0 tx=0x7f29c801c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c28801e5d460972 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.232 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29bbfff640 1 -- 10.20.193.77:0/3126687454 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c80b2070 con 0x7f29cc0a5070 2026-02-17T12:07:30.233 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.233 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29bbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:30.233 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29bbfff640 10 monclient: dump: 2026-02-17T12:07:30.233 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.233 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.233 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.233 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.233 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.233 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.233 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.233 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.233 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.234 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.234 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29bbfff640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.234 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29bbfff640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.234 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.234 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29bbfff640 1 -- 10.20.193.77:0/3126687454 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c80a5840 con 0x7f29cc0a5070 2026-02-17T12:07:30.234 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29bbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.234 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29bbfff640 1 -- 10.20.193.77:0/3126687454 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c80a5c10 con 0x7f29cc0a5070 2026-02-17T12:07:30.234 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.234 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:30.234 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29bbfff640 10 monclient: dump: 2026-02-17T12:07:30.234 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.235 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.235 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.235 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.235 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.235 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.235 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.235 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.235 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.235 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 5 monclient: authenticate success, global_id 4484 2026-02-17T12:07:30.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:30.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 4 set_mon_vals no callback set 2026-02-17T12:07:30.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient: shutdown 2026-02-17T12:07:30.236 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:30.236 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 -- 10.20.193.77:0/3126687454 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f29cc0a5070 msgr2=0x7f29cc140ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.236 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 --2- 10.20.193.77:0/3126687454 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f29cc0a5070 0x7f29cc140ba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009dc0 tx=0x7f29c801c810 comp rx=0 tx=0).stop 2026-02-17T12:07:30.236 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 -- 10.20.193.77:0/3126687454 shutdown_connections 2026-02-17T12:07:30.236 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 --2- 10.20.193.77:0/3126687454 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f29cc0a5070 0x7f29cc140ba0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.236 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 -- 10.20.193.77:0/3126687454 >> 10.20.193.77:0/3126687454 conn(0x7f29cc074ba0 msgr2=0x7f29cc0aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:30.236 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 -- 10.20.193.77:0/3126687454 shutdown_connections 2026-02-17T12:07:30.236 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 -- 10.20.193.77:0/3126687454 wait complete. 2026-02-17T12:07:30.236 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient: build_initial_monmap 2026-02-17T12:07:30.236 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient: monmap: 2026-02-17T12:07:30.236 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:30.236 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:30.237 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:30.237 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:30.237 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:30.237 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.237 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:30.237 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:30.237 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:30.237 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.237 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 Processor -- start 2026-02-17T12:07:30.237 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 -- start start 2026-02-17T12:07:30.237 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient: init 2026-02-17T12:07:30.237 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.238 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:07:30.238 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f29cc09be20 0x7f29cc1d2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.238 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient(hunting): picked mon.noname-a con 0x7f29cc09be20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:30.238 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f29cc0a4c20 0x7f29cc1404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.238 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient(hunting): picked mon.noname-c con 0x7f29cc0a4c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:30.238 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f29cc0a5070 0x7f29cc1409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.238 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient(hunting): picked mon.noname-b con 0x7f29cc0a5070 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:30.238 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.238 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc143c90 con 0x7f29cc09be20 2026-02-17T12:07:30.238 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.238 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc143b10 con 0x7f29cc0a5070 2026-02-17T12:07:30.238 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.238 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f29cc143e10 con 0x7f29cc0a4c20 2026-02-17T12:07:30.239 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.239 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d388c640 10 monclient(hunting): authenticate will time out at 701.901961s 2026-02-17T12:07:30.239 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f29cc09be20 0x7f29cc1d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.239 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d0e00640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f29cc0a4c20 0x7f29cc1404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.239 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f29cc09be20 0x7f29cc1d2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:54778/0 (socket says 10.20.193.77:54778) 2026-02-17T12:07:30.239 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 1 -- 10.20.193.77:0/2277227841 learned_addr learned my addr 10.20.193.77:0/2277227841 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:30.239 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 10 monclient(hunting): get_auth_request con 0x7f29cc09be20 auth_method 0 2026-02-17T12:07:30.239 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.239 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.239 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.239 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d0e00640 10 monclient(hunting): get_auth_request con 0x7f29cc0a4c20 auth_method 0 2026-02-17T12:07:30.240 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d0e00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.240 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d0e00640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.240 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d0e00640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.240 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.240 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.240 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.240 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d0e00640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.240 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d0e00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.240 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d0e00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.240 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 10 monclient(hunting): handle_auth_done global_id 4500 payload 824 2026-02-17T12:07:30.240 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 1 -- 10.20.193.77:0/2277227841 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f29cc0a4c20 msgr2=0x7f29cc1404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.240 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 1 --2- 10.20.193.77:0/2277227841 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f29cc0a4c20 0x7f29cc1404a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.240 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 1 -- 10.20.193.77:0/2277227841 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f29cc0a5070 msgr2=0x7f29cc1409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.241 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 1 --2- 10.20.193.77:0/2277227841 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f29cc0a5070 0x7f29cc1409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.241 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.241 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 1 monclient: found mon.noname-a 2026-02-17T12:07:30.241 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.241 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:30.241 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.223+0000 7f29d1601640 1 -- 10.20.193.77:0/2277227841 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29cc06f590 con 0x7f29cc09be20 2026-02-17T12:07:30.241 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d1601640 1 -- 10.20.193.77:0/2277227841 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f29cc09be20 msgr2=0x7f29cc1d2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.241 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 1 -- 10.20.193.77:0/2277227841 DispatchQueue::entry inject delay of 0.002000 2026-02-17T12:07:30.241 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d1601640 1 --2- 10.20.193.77:0/2277227841 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f29cc09be20 0x7f29cc1d2140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00c580 tx=0x7f29bc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.243 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 1 -- 10.20.193.77:0/2277227841 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc016020 con 0x7f29cc09be20 2026-02-17T12:07:30.243 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.243 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:30.244 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 10 monclient: dump: 2026-02-17T12:07:30.244 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.244 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.244 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.244 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.244 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.244 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.244 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.244 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.244 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.244 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.244 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.245 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.245 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.245 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 1 -- 10.20.193.77:0/2277227841 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29bc012a60 con 0x7f29cc09be20 2026-02-17T12:07:30.245 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.245 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 1 -- 10.20.193.77:0/2277227841 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc012e50 con 0x7f29cc09be20 2026-02-17T12:07:30.245 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.245 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:30.245 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 10 monclient: dump: 2026-02-17T12:07:30.245 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.245 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.245 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.245 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.246 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.246 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.246 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.246 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.246 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.246 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.246 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29bb7fe640 4 set_mon_vals no callback set 2026-02-17T12:07:30.246 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d388c640 5 monclient: authenticate success, global_id 4500 2026-02-17T12:07:30.246 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d388c640 10 monclient: _renew_subs 2026-02-17T12:07:30.246 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d388c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:30.246 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d388c640 1 -- 10.20.193.77:0/2277227841 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29cc0a4600 con 0x7f29cc09be20 2026-02-17T12:07:30.246 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d388c640 10 monclient: _renew_subs 2026-02-17T12:07:30.246 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d388c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:30.247 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d388c640 1 -- 10.20.193.77:0/2277227841 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29cc13a6b0 con 0x7f29cc09be20 2026-02-17T12:07:30.247 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d388c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:30.247 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d388c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:30.247 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d388c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:30.247 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d388c640 1 -- 10.20.193.77:0/2277227841 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29cc134e00 con 0x7f29cc09be20 2026-02-17T12:07:30.247 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 1 -- 10.20.193.77:0/2277227841 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f29bc01b400 con 0x7f29cc09be20 2026-02-17T12:07:30.247 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 1 --2- 10.20.193.77:0/2277227841 >> v2:10.20.193.119:6800/4127986552 conn(0x7f299c03a310 0x7f299c03c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.247 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29b9ffb640 1 -- 10.20.193.77:0/2277227841 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f29bc04dc50 con 0x7f29cc09be20 2026-02-17T12:07:30.247 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d0e00640 1 --2- 10.20.193.77:0/2277227841 >> v2:10.20.193.119:6800/4127986552 conn(0x7f299c03a310 0x7f299c03c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.247 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.227+0000 7f29d0e00640 10 monclient: get_auth_request con 0x7f299c03a310 auth_method 0 2026-02-17T12:07:30.247 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.231+0000 7f29d0e00640 1 --2- 10.20.193.77:0/2277227841 >> v2:10.20.193.119:6800/4127986552 conn(0x7f299c03a310 0x7f299c03c7d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f29c0007da0 tx=0x7f29c0007cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.247 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.231+0000 7f29b9ffb640 1 -- 10.20.193.77:0/2277227841 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f29bc020020 con 0x7f29cc09be20 2026-02-17T12:07:30.248 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.231+0000 7f29b9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:30.248 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.231+0000 7f29b9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:30.311 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 1 -- 10.20.193.77:0/2277227841 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f29cc1397c0 con 0x7f299c03a310 2026-02-17T12:07:30.312 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29b9ffb640 1 -- 10.20.193.77:0/2277227841 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f29cc1397c0 con 0x7f299c03a310 2026-02-17T12:07:30.312 INFO:teuthology.orchestra.run.trial077.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T12:07:30.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 1 -- 10.20.193.77:0/2277227841 >> v2:10.20.193.119:6800/4127986552 conn(0x7f299c03a310 msgr2=0x7f299c03c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 1 --2- 10.20.193.77:0/2277227841 >> v2:10.20.193.119:6800/4127986552 conn(0x7f299c03a310 0x7f299c03c7d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f29c0007da0 tx=0x7f29c0007cf0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 10 monclient: shutdown 2026-02-17T12:07:30.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:30.313 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 1 -- 10.20.193.77:0/2277227841 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f29cc09be20 msgr2=0x7f29cc1d2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 1 --2- 10.20.193.77:0/2277227841 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f29cc09be20 0x7f29cc1d2140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00c580 tx=0x7f29bc00ca40 comp rx=0 tx=0).stop 2026-02-17T12:07:30.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 1 -- 10.20.193.77:0/2277227841 shutdown_connections 2026-02-17T12:07:30.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 1 --2- 10.20.193.77:0/2277227841 >> v2:10.20.193.119:6800/4127986552 conn(0x7f299c03a310 0x7f299c03c7d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 1 --2- 10.20.193.77:0/2277227841 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f29cc0a5070 0x7f29cc1409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 1 --2- 10.20.193.77:0/2277227841 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f29cc0a4c20 0x7f29cc1404a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 1 --2- 10.20.193.77:0/2277227841 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f29cc09be20 0x7f29cc1d2140 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 1 -- 10.20.193.77:0/2277227841 >> 10.20.193.77:0/2277227841 conn(0x7f29cc074ba0 msgr2=0x7f29cc137cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:30.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 1 -- 10.20.193.77:0/2277227841 shutdown_connections 2026-02-17T12:07:30.314 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.307+0000 7f29d388c640 1 -- 10.20.193.77:0/2277227841 wait complete. 2026-02-17T12:07:30.323 INFO:tasks.ceph:Scrubbing osd.3 2026-02-17T12:07:30.323 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:07:30.382 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.375+0000 7f2e94f0c640 10 monclient: get_monmap_and_config 2026-02-17T12:07:30.382 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.375+0000 7f2e94f0c640 10 monclient: build_initial_monmap 2026-02-17T12:07:30.383 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.375+0000 7f2e94f0c640 10 monclient: monmap: 2026-02-17T12:07:30.383 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:30.383 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.383 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:30.381011+0000 2026-02-17T12:07:30.383 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:30.381011+0000 2026-02-17T12:07:30.383 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:30.383 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.383 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:30.383 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:30.383 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:30.383 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:30.384 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:30.384 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 1 Processor -- start 2026-02-17T12:07:30.392 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 1 -- start start 2026-02-17T12:07:30.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 10 monclient: init 2026-02-17T12:07:30.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 10 monclient: _add_conns ranks=[3,4,0,1,2] 2026-02-17T12:07:30.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f2e900a0280 0x7f2e900a0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 10 monclient(hunting): picked mon.noname-a con 0x7f2e900a0280 addr v2:10.20.193.77:3300/0 2026-02-17T12:07:30.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f2e900a2a30 0x7f2e9009a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 10 monclient(hunting): picked mon.noname-c con 0x7f2e900a2a30 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:30.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2e9009acd0 addr v1:10.20.193.77:6789/0 2026-02-17T12:07:30.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9009cae0 con 0x7f2e9009acd0 2026-02-17T12:07:30.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2e9009a470 con 0x7f2e900a0280 2026-02-17T12:07:30.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f2e900a41d0 con 0x7f2e900a2a30 2026-02-17T12:07:30.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e94f0c640 10 monclient(hunting): authenticate will time out at 702.056520s 2026-02-17T12:07:30.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f2e900a0280 0x7f2e900a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8ed76640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f2e9009acd0 0x7f2e901439a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:51666/0 (socket says 10.20.193.77:51666) 2026-02-17T12:07:30.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8ed76640 1 -- 10.20.193.77:0/3819091971 learned_addr learned my addr 10.20.193.77:0/3819091971 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:07:30.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 10 monclient(hunting): get_auth_request con 0x7f2e900a0280 auth_method 0 2026-02-17T12:07:30.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8dd74640 1 --2- 10.20.193.77:0/3819091971 >> v2:10.20.193.119:3300/0 conn(0x7f2e900a2a30 0x7f2e9009a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 10 monclient(hunting): handle_auth_done global_id 4503 payload 274 2026-02-17T12:07:30.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 1 -- 10.20.193.77:0/3819091971 >> v2:10.20.193.119:3300/0 conn(0x7f2e900a2a30 msgr2=0x7f2e9009a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:30.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 1 --2- 10.20.193.77:0/3819091971 >> v2:10.20.193.119:3300/0 conn(0x7f2e900a2a30 0x7f2e9009a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 1 -- 10.20.193.77:0/3819091971 >> v1:10.20.193.77:6789/0 conn(0x7f2e9009acd0 legacy=0x7f2e901439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:30.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 1 monclient: found mon.noname-a 2026-02-17T12:07:30.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:30.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 1 -- 10.20.193.77:0/3819091971 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9009c800 con 0x7f2e900a0280 2026-02-17T12:07:30.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8dd74640 10 monclient: get_auth_request con 0x7f2e900a2a30 auth_method 0 2026-02-17T12:07:30.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8dd74640 1 --2- 10.20.193.77:0/3819091971 >> v2:10.20.193.119:3300/0 conn(0x7f2e900a2a30 0x7f2e9009a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:07:30.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 1 -- 10.20.193.77:0/3819091971 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e900a0280 msgr2=0x7f2e900a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.379+0000 7f2e8e575640 1 --2- 10.20.193.77:0/3819091971 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e900a0280 0x7f2e900a0660 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2e90077600 tx=0x7f2e8401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b74e583215b327 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8d573640 1 -- 10.20.193.77:0/3819091971 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e840b0070 con 0x7f2e900a0280 2026-02-17T12:07:30.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:30.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8d573640 10 monclient: dump: 2026-02-17T12:07:30.396 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.396 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.396 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.396 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.397 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.397 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.397 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.397 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.397 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.397 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8d573640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8d573640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8d573640 1 -- 10.20.193.77:0/3819091971 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e840ab600 con 0x7f2e900a0280 2026-02-17T12:07:30.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8d573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 5 monclient: authenticate success, global_id 4503 2026-02-17T12:07:30.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8d573640 1 -- 10.20.193.77:0/3819091971 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e840ab9d0 con 0x7f2e900a0280 2026-02-17T12:07:30.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:30.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 4 set_mon_vals no callback set 2026-02-17T12:07:30.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:30.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8d573640 10 monclient: dump: 2026-02-17T12:07:30.398 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.398 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.398 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.398 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.398 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.398 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.398 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.399 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.399 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.399 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient: shutdown 2026-02-17T12:07:30.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:30.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 -- 10.20.193.77:0/3819091971 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e900a0280 msgr2=0x7f2e900a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 --2- 10.20.193.77:0/3819091971 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e900a0280 0x7f2e900a0660 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2e90077600 tx=0x7f2e8401c460 comp rx=0 tx=0).stop 2026-02-17T12:07:30.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 -- 10.20.193.77:0/3819091971 shutdown_connections 2026-02-17T12:07:30.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 --2- 10.20.193.77:0/3819091971 >> v2:10.20.193.119:3300/0 conn(0x7f2e900a2a30 0x7f2e9009a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 --2- 10.20.193.77:0/3819091971 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e900a0280 0x7f2e900a0660 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 -- 10.20.193.77:0/3819091971 >> 10.20.193.77:0/3819091971 conn(0x7f2e900a7420 msgr2=0x7f2e900a3290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:30.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 -- 10.20.193.77:0/3819091971 shutdown_connections 2026-02-17T12:07:30.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 -- 10.20.193.77:0/3819091971 wait complete. 2026-02-17T12:07:30.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient: build_initial_monmap 2026-02-17T12:07:30.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient: monmap: 2026-02-17T12:07:30.400 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:30.400 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:30.400 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:30.400 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:30.400 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:30.400 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.400 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:30.400 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:30.400 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:30.400 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 Processor -- start 2026-02-17T12:07:30.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 -- start start 2026-02-17T12:07:30.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient: init 2026-02-17T12:07:30.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:07:30.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e9009acd0 0x7f2e90070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient(hunting): picked mon.noname-b con 0x7f2e9009acd0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:30.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f2e900a0280 0x7f2e90070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient(hunting): picked mon.noname-c con 0x7f2e900a0280 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:30.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e900a2a30 0x7f2e901d6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient(hunting): picked mon.noname-a con 0x7f2e900a2a30 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:30.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9009de10 con 0x7f2e900a2a30 2026-02-17T12:07:30.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9009dc90 con 0x7f2e9009acd0 2026-02-17T12:07:30.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2e901478e0 con 0x7f2e900a0280 2026-02-17T12:07:30.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e94f0c640 10 monclient(hunting): authenticate will time out at 702.061770s 2026-02-17T12:07:30.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f2e900a0280 0x7f2e90070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8ed76640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e900a2a30 0x7f2e901d6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f2e900a0280 0x7f2e90070570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:59502/0 (socket says 10.20.193.77:59502) 2026-02-17T12:07:30.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 1 -- 10.20.193.77:0/322625799 learned_addr learned my addr 10.20.193.77:0/322625799 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:30.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 10 monclient(hunting): get_auth_request con 0x7f2e900a0280 auth_method 0 2026-02-17T12:07:30.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8ed76640 10 monclient(hunting): get_auth_request con 0x7f2e900a2a30 auth_method 0 2026-02-17T12:07:30.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 10 monclient(hunting): handle_auth_done global_id 4490 payload 824 2026-02-17T12:07:30.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 1 -- 10.20.193.77:0/322625799 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e9009acd0 msgr2=0x7f2e90070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8e575640 1 --2- 10.20.193.77:0/322625799 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e9009acd0 0x7f2e90070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 1 --2- 10.20.193.77:0/322625799 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e9009acd0 0x7f2e90070030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 1 -- 10.20.193.77:0/322625799 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e900a2a30 msgr2=0x7f2e901d6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 1 --2- 10.20.193.77:0/322625799 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e900a2a30 0x7f2e901d6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 1 monclient: found mon.noname-c 2026-02-17T12:07:30.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8dd74640 1 -- 10.20.193.77:0/322625799 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e90070f60 con 0x7f2e900a0280 2026-02-17T12:07:30.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8e575640 10 monclient: get_auth_request con 0x7f2e9009acd0 auth_method 0 2026-02-17T12:07:30.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8e575640 1 --2- 10.20.193.77:0/322625799 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e9009acd0 0x7f2e90070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T12:07:30.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.383+0000 7f2e8ed76640 1 --2- 10.20.193.77:0/322625799 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e900a2a30 0x7f2e901d6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:30.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e8dd74640 1 -- 10.20.193.77:0/322625799 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f2e900a0280 msgr2=0x7f2e90070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e8dd74640 1 --2- 10.20.193.77:0/322625799 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f2e900a0280 0x7f2e90070570 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800c7d0 tx=0x7f2e7800cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 1 -- 10.20.193.77:0/322625799 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e78015070 con 0x7f2e900a0280 2026-02-17T12:07:30.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:30.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 10 monclient: dump: 2026-02-17T12:07:30.405 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.405 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.406 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.406 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.406 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.406 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.406 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.406 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.406 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.406 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 1 -- 10.20.193.77:0/322625799 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7800acd0 con 0x7f2e900a0280 2026-02-17T12:07:30.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.407 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 1 -- 10.20.193.77:0/322625799 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e78011630 con 0x7f2e900a0280 2026-02-17T12:07:30.407 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.407 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:30.407 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 10 monclient: dump: 2026-02-17T12:07:30.407 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.407 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.407 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.407 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.407 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.407 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.407 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.408 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.408 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.408 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.408 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e8cd72640 4 set_mon_vals no callback set 2026-02-17T12:07:30.408 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e94f0c640 5 monclient: authenticate success, global_id 4490 2026-02-17T12:07:30.408 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e94f0c640 10 monclient: _renew_subs 2026-02-17T12:07:30.408 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e94f0c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.408 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e94f0c640 1 -- 10.20.193.77:0/322625799 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e90072130 con 0x7f2e900a0280 2026-02-17T12:07:30.408 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e94f0c640 10 monclient: _renew_subs 2026-02-17T12:07:30.408 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e94f0c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.408 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e94f0c640 1 -- 10.20.193.77:0/322625799 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e90071e50 con 0x7f2e900a0280 2026-02-17T12:07:30.408 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e94f0c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e94f0c640 1 -- 10.20.193.77:0/322625799 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2e900a0660 con 0x7f2e900a0280 2026-02-17T12:07:30.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 1 -- 10.20.193.77:0/322625799 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f2e78011810 con 0x7f2e900a0280 2026-02-17T12:07:30.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 1 --2- 10.20.193.77:0/322625799 >> v2:10.20.193.119:6800/4127986552 conn(0x7f2e5c03a170 0x7f2e5c03c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 1 -- 10.20.193.77:0/322625799 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f2e7804de30 con 0x7f2e900a0280 2026-02-17T12:07:30.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 1 --2- 10.20.193.77:0/322625799 >> v2:10.20.193.119:6801/3041501560 conn(0x7f2e5c03fd00 0x7f2e5c042120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 1 -- 10.20.193.77:0/322625799 --> v2:10.20.193.119:6801/3041501560 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e78019ec0 con 0x7f2e5c03fd00 2026-02-17T12:07:30.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 1 -- 10.20.193.77:0/322625799 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2e78050400 con 0x7f2e900a0280 2026-02-17T12:07:30.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e76ffd640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-17T12:07:30.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e8e575640 1 --2- 10.20.193.77:0/322625799 >> v2:10.20.193.119:6800/4127986552 conn(0x7f2e5c03a170 0x7f2e5c03c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e8e575640 10 monclient: get_auth_request con 0x7f2e5c03a170 auth_method 0 2026-02-17T12:07:30.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e8ed76640 1 --2- 10.20.193.77:0/322625799 >> v2:10.20.193.119:6801/3041501560 conn(0x7f2e5c03fd00 0x7f2e5c042120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.409 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.387+0000 7f2e8ed76640 10 monclient: get_auth_request con 0x7f2e5c03fd00 auth_method 0 2026-02-17T12:07:30.410 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.391+0000 7f2e8e575640 1 --2- 10.20.193.77:0/322625799 >> v2:10.20.193.119:6800/4127986552 conn(0x7f2e5c03a170 0x7f2e5c03c630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e840ab000 tx=0x7f2e840a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.391+0000 7f2e8ed76640 1 --2- 10.20.193.77:0/322625799 >> v2:10.20.193.119:6801/3041501560 conn(0x7f2e5c03fd00 0x7f2e5c042120 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.391+0000 7f2e76ffd640 1 -- 10.20.193.77:0/322625799 <== osd.3 v2:10.20.193.119:6801/3041501560 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f2e78019ec0 con 0x7f2e5c03fd00 2026-02-17T12:07:30.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e94f0c640 1 -- 10.20.193.77:0/322625799 --> v2:10.20.193.119:6801/3041501560 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2e90070ce0 con 0x7f2e5c03fd00 2026-02-17T12:07:30.411 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e76ffd640 1 -- 10.20.193.77:0/322625799 <== osd.3 v2:10.20.193.119:6801/3041501560 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2e90070ce0 con 0x7f2e5c03fd00 2026-02-17T12:07:30.411 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T12:07:30.411 INFO:teuthology.orchestra.run.trial077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:07:30.412 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T12:07:30.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e94f0c640 1 -- 10.20.193.77:0/322625799 >> v2:10.20.193.119:6801/3041501560 conn(0x7f2e5c03fd00 msgr2=0x7f2e5c042120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.413 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e94f0c640 1 --2- 10.20.193.77:0/322625799 >> v2:10.20.193.119:6801/3041501560 conn(0x7f2e5c03fd00 0x7f2e5c042120 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e94f0c640 1 -- 10.20.193.77:0/322625799 >> v2:10.20.193.119:6800/4127986552 conn(0x7f2e5c03a170 msgr2=0x7f2e5c03c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e94f0c640 1 --2- 10.20.193.77:0/322625799 >> v2:10.20.193.119:6800/4127986552 conn(0x7f2e5c03a170 0x7f2e5c03c630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e840ab000 tx=0x7f2e840a6000 comp rx=0 tx=0).stop 2026-02-17T12:07:30.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e94f0c640 10 monclient: shutdown 2026-02-17T12:07:30.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e94f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:30.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e94f0c640 1 -- 10.20.193.77:0/322625799 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f2e900a0280 msgr2=0x7f2e90070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e94f0c640 1 --2- 10.20.193.77:0/322625799 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f2e900a0280 0x7f2e90070570 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800c7d0 tx=0x7f2e7800cc90 comp rx=0 tx=0).stop 2026-02-17T12:07:30.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e8ed76640 1 -- 10.20.193.77:0/322625799 reap_dead start 2026-02-17T12:07:30.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e94f0c640 1 -- 10.20.193.77:0/322625799 shutdown_connections 2026-02-17T12:07:30.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e94f0c640 1 -- 10.20.193.77:0/322625799 >> 10.20.193.77:0/322625799 conn(0x7f2e900a7420 msgr2=0x7f2e9013fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:30.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e94f0c640 1 -- 10.20.193.77:0/322625799 shutdown_connections 2026-02-17T12:07:30.414 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.399+0000 7f2e94f0c640 1 -- 10.20.193.77:0/322625799 wait complete. 2026-02-17T12:07:30.415 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-17T12:07:30.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.467+0000 7f30b0246640 10 monclient: get_monmap_and_config 2026-02-17T12:07:30.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.467+0000 7f30b0246640 10 monclient: build_initial_monmap 2026-02-17T12:07:30.474 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.467+0000 7f30b0246640 10 monclient: monmap: 2026-02-17T12:07:30.474 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:30.474 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.474 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:30.472397+0000 2026-02-17T12:07:30.475 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:30.472397+0000 2026-02-17T12:07:30.475 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:30.475 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.475 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:30.475 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:30.475 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:30.475 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:30.475 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:30.475 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.467+0000 7f30b0246640 1 Processor -- start 2026-02-17T12:07:30.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.467+0000 7f30b0246640 1 -- start start 2026-02-17T12:07:30.475 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.467+0000 7f30b0246640 10 monclient: init 2026-02-17T12:07:30.478 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.467+0000 7f30b0246640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.478 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.467+0000 7f30b0246640 10 monclient: _add_conns ranks=[1,2,4,3,0] 2026-02-17T12:07:30.478 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.467+0000 7f30b0246640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f30a80a3290 addr v1:10.20.193.119:6789/0 2026-02-17T12:07:30.478 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.467+0000 7f30b0246640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a80a3d80 0x7f30a806da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.478 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.467+0000 7f30b0246640 10 monclient(hunting): picked mon.noname-b con 0x7f30a80a3d80 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:30.478 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30b0246640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f30a813d780 0x7f30a813fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.478 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30b0246640 10 monclient(hunting): picked mon.noname-c con 0x7f30a813d780 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:30.478 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30b0246640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a806ee50 con 0x7f30a80a3290 2026-02-17T12:07:30.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30b0246640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30b0246640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f30a80750b0 con 0x7f30a813d780 2026-02-17T12:07:30.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30b0246640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30b0246640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f30a80a5090 con 0x7f30a80a3d80 2026-02-17T12:07:30.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30b0246640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30b0246640 10 monclient(hunting): authenticate will time out at 702.148042s 2026-02-17T12:07:30.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a80a3d80 0x7f30a806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.479 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a80a3d80 0x7f30a806da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:59514/0 (socket says 10.20.193.77:59514) 2026-02-17T12:07:30.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ae7bc640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f30a813d780 0x7f30a813fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 1 -- 10.20.193.77:0/4177506057 learned_addr learned my addr 10.20.193.77:0/4177506057 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:30.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 10 monclient(hunting): get_auth_request con 0x7f30a80a3d80 auth_method 0 2026-02-17T12:07:30.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ae7bc640 10 monclient(hunting): get_auth_request con 0x7f30a813d780 auth_method 0 2026-02-17T12:07:30.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ae7bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ae7bc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ae7bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.480 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ae7bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ae7bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ae7bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 10 monclient(hunting): handle_auth_done global_id 4493 payload 274 2026-02-17T12:07:30.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 1 -- 10.20.193.77:0/4177506057 >> v2:10.20.193.119:3300/0 conn(0x7f30a813d780 msgr2=0x7f30a813fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:30.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 1 --2- 10.20.193.77:0/4177506057 >> v2:10.20.193.119:3300/0 conn(0x7f30a813d780 0x7f30a813fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 1 -- 10.20.193.77:0/4177506057 >> v1:10.20.193.119:6789/0 conn(0x7f30a80a3290 legacy=0x7f30a80a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:30.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 1 monclient: found mon.noname-b 2026-02-17T12:07:30.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.481 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.482 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.471+0000 7f30ad7ba640 1 -- 10.20.193.77:0/4177506057 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a80a4e10 con 0x7f30a80a3d80 2026-02-17T12:07:30.487 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ad7ba640 1 -- 10.20.193.77:0/4177506057 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a80a3d80 msgr2=0x7f30a806da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ad7ba640 1 --2- 10.20.193.77:0/4177506057 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a80a3d80 0x7f30a806da30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f309c009970 tx=0x7f309c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c92c712d64c65e7f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30acfb9640 1 -- 10.20.193.77:0/4177506057 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c0b0070 con 0x7f30a80a3d80 2026-02-17T12:07:30.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30acfb9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30acfb9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:30.488 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30acfb9640 10 monclient: dump: 2026-02-17T12:07:30.488 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.488 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.488 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.488 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.488 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.488 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.489 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.489 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.489 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.489 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30acfb9640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30acfb9640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30acfb9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30acfb9640 1 -- 10.20.193.77:0/4177506057 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c004230 con 0x7f30a80a3d80 2026-02-17T12:07:30.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30acfb9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 5 monclient: authenticate success, global_id 4493 2026-02-17T12:07:30.489 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30acfb9640 1 -- 10.20.193.77:0/4177506057 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c003720 con 0x7f30a80a3d80 2026-02-17T12:07:30.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:30.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 4 set_mon_vals no callback set 2026-02-17T12:07:30.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30acfb9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30acfb9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:30.490 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30acfb9640 10 monclient: dump: 2026-02-17T12:07:30.490 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.490 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.490 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.490 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.490 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.490 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.490 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.490 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.490 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.491 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient: shutdown 2026-02-17T12:07:30.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:30.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 -- 10.20.193.77:0/4177506057 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a80a3d80 msgr2=0x7f30a806da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 --2- 10.20.193.77:0/4177506057 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a80a3d80 0x7f30a806da30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f309c009970 tx=0x7f309c01c540 comp rx=0 tx=0).stop 2026-02-17T12:07:30.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 -- 10.20.193.77:0/4177506057 shutdown_connections 2026-02-17T12:07:30.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 --2- 10.20.193.77:0/4177506057 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a80a3d80 0x7f30a806da30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 --2- 10.20.193.77:0/4177506057 >> v2:10.20.193.119:3300/0 conn(0x7f30a813d780 0x7f30a813fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 -- 10.20.193.77:0/4177506057 >> 10.20.193.77:0/4177506057 conn(0x7f30a80a8890 msgr2=0x7f30a80a8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:30.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 -- 10.20.193.77:0/4177506057 shutdown_connections 2026-02-17T12:07:30.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 -- 10.20.193.77:0/4177506057 wait complete. 2026-02-17T12:07:30.491 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient: build_initial_monmap 2026-02-17T12:07:30.492 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient: monmap: 2026-02-17T12:07:30.492 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:30.492 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:30.492 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:30.492 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:30.492 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:30.492 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.492 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:30.492 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:30.492 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:30.492 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.492 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 Processor -- start 2026-02-17T12:07:30.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 -- start start 2026-02-17T12:07:30.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient: init 2026-02-17T12:07:30.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T12:07:30.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f30a80a3290 0x7f30a8138440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient(hunting): picked mon.noname-b con 0x7f30a80a3290 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:30.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f30a80a3d80 0x7f30a8138980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient(hunting): picked mon.noname-a con 0x7f30a80a3d80 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:30.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a813d780 0x7f30a81d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient(hunting): picked mon.noname-c con 0x7f30a813d780 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:30.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8142c60 con 0x7f30a80a3d80 2026-02-17T12:07:30.493 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8142ae0 con 0x7f30a80a3290 2026-02-17T12:07:30.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f30a8142de0 con 0x7f30a813d780 2026-02-17T12:07:30.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30b0246640 10 monclient(hunting): authenticate will time out at 702.154108s 2026-02-17T12:07:30.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ad7ba640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f30a80a3d80 0x7f30a8138980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a813d780 0x7f30a81d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ad7ba640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f30a80a3d80 0x7f30a8138980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:54802/0 (socket says 10.20.193.77:54802) 2026-02-17T12:07:30.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a813d780 0x7f30a81d1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:59524/0 (socket says 10.20.193.77:59524) 2026-02-17T12:07:30.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ad7ba640 1 -- 10.20.193.77:0/319473754 learned_addr learned my addr 10.20.193.77:0/319473754 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:30.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ad7ba640 10 monclient(hunting): get_auth_request con 0x7f30a80a3d80 auth_method 0 2026-02-17T12:07:30.494 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ad7ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ad7ba640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ad7ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 10 monclient(hunting): get_auth_request con 0x7f30a813d780 auth_method 0 2026-02-17T12:07:30.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ad7ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ad7ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30adfbb640 1 --2- 10.20.193.77:0/319473754 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f30a80a3290 0x7f30a8138440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.495 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ad7ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30adfbb640 10 monclient(hunting): get_auth_request con 0x7f30a80a3290 auth_method 0 2026-02-17T12:07:30.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30adfbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30adfbb640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30adfbb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 10 monclient(hunting): handle_auth_done global_id 4496 payload 824 2026-02-17T12:07:30.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 1 -- 10.20.193.77:0/319473754 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f30a80a3290 msgr2=0x7f30a8138440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 1 --2- 10.20.193.77:0/319473754 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f30a80a3290 0x7f30a8138440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 1 -- 10.20.193.77:0/319473754 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f30a80a3d80 msgr2=0x7f30a8138980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 1 --2- 10.20.193.77:0/319473754 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f30a80a3d80 0x7f30a8138980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 1 monclient: found mon.noname-c 2026-02-17T12:07:30.496 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.497 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.497 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.475+0000 7f30ae7bc640 1 -- 10.20.193.77:0/319473754 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a813d1b0 con 0x7f30a813d780 2026-02-17T12:07:30.497 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30ae7bc640 1 -- 10.20.193.77:0/319473754 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a813d780 msgr2=0x7f30a81d1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.497 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30ae7bc640 1 --2- 10.20.193.77:0/319473754 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a813d780 0x7f30a81d1fd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f30a400ef90 tx=0x7f30a400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.497 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 1 -- 10.20.193.77:0/319473754 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4018020 con 0x7f30a813d780 2026-02-17T12:07:30.497 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.497 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:30.497 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 10 monclient: dump: 2026-02-17T12:07:30.497 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.497 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.497 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.497 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.497 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.498 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.498 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.498 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.498 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.498 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.498 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.498 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.498 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.498 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 1 -- 10.20.193.77:0/319473754 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a40146a0 con 0x7f30a813d780 2026-02-17T12:07:30.498 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.498 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 1 -- 10.20.193.77:0/319473754 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4014a90 con 0x7f30a813d780 2026-02-17T12:07:30.498 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30b0246640 5 monclient: authenticate success, global_id 4496 2026-02-17T12:07:30.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30b0246640 10 monclient: _renew_subs 2026-02-17T12:07:30.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30b0246640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f3097fff640 4 set_mon_vals no callback set 2026-02-17T12:07:30.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30b0246640 1 -- 10.20.193.77:0/319473754 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a813d490 con 0x7f30a813d780 2026-02-17T12:07:30.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:30.499 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 10 monclient: dump: 2026-02-17T12:07:30.499 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.499 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.499 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.499 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.499 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.499 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.500 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.500 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.500 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.500 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30b0246640 10 monclient: _renew_subs 2026-02-17T12:07:30.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30b0246640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30b0246640 1 -- 10.20.193.77:0/319473754 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a813bf20 con 0x7f30a813d780 2026-02-17T12:07:30.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30b0246640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:30.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30b0246640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:30.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30b0246640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30b0246640 1 -- 10.20.193.77:0/319473754 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a806da30 con 0x7f30a813d780 2026-02-17T12:07:30.500 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 1 -- 10.20.193.77:0/319473754 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f30a4014c30 con 0x7f30a813d780 2026-02-17T12:07:30.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 1 --2- 10.20.193.77:0/319473754 >> v2:10.20.193.119:6800/4127986552 conn(0x7f307803a170 0x7f307803c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30967fc640 1 -- 10.20.193.77:0/319473754 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f30a404e8f0 con 0x7f30a813d780 2026-02-17T12:07:30.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30adfbb640 1 --2- 10.20.193.77:0/319473754 >> v2:10.20.193.119:6800/4127986552 conn(0x7f307803a170 0x7f307803c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.479+0000 7f30adfbb640 10 monclient: get_auth_request con 0x7f307803a170 auth_method 0 2026-02-17T12:07:30.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.483+0000 7f30adfbb640 1 --2- 10.20.193.77:0/319473754 >> v2:10.20.193.119:6800/4127986552 conn(0x7f307803a170 0x7f307803c630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f30a813add0 tx=0x7f3098009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.483+0000 7f30967fc640 1 -- 10.20.193.77:0/319473754 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f30a4022030 con 0x7f30a813d780 2026-02-17T12:07:30.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.483+0000 7f30967fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:30.501 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.483+0000 7f30967fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:30.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 1 -- 10.20.193.77:0/319473754 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f30a813ba80 con 0x7f307803a170 2026-02-17T12:07:30.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30967fc640 1 -- 10.20.193.77:0/319473754 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f30a813ba80 con 0x7f307803a170 2026-02-17T12:07:30.562 INFO:teuthology.orchestra.run.trial077.stderr:instructed osd(s) 3 to deep-scrub 2026-02-17T12:07:30.563 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 1 -- 10.20.193.77:0/319473754 >> v2:10.20.193.119:6800/4127986552 conn(0x7f307803a170 msgr2=0x7f307803c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.563 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 1 --2- 10.20.193.77:0/319473754 >> v2:10.20.193.119:6800/4127986552 conn(0x7f307803a170 0x7f307803c630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f30a813add0 tx=0x7f3098009040 comp rx=0 tx=0).stop 2026-02-17T12:07:30.563 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 10 monclient: shutdown 2026-02-17T12:07:30.563 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:30.563 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 1 -- 10.20.193.77:0/319473754 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a813d780 msgr2=0x7f30a81d1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.563 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 1 --2- 10.20.193.77:0/319473754 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a813d780 0x7f30a81d1fd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f30a400ef90 tx=0x7f30a400c490 comp rx=0 tx=0).stop 2026-02-17T12:07:30.563 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 1 -- 10.20.193.77:0/319473754 shutdown_connections 2026-02-17T12:07:30.563 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 1 --2- 10.20.193.77:0/319473754 >> v2:10.20.193.119:6800/4127986552 conn(0x7f307803a170 0x7f307803c630 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.563 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 1 --2- 10.20.193.77:0/319473754 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f30a813d780 0x7f30a81d1fd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.563 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 1 --2- 10.20.193.77:0/319473754 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f30a80a3d80 0x7f30a8138980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.564 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 1 --2- 10.20.193.77:0/319473754 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f30a80a3290 0x7f30a8138440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.564 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 1 -- 10.20.193.77:0/319473754 >> 10.20.193.77:0/319473754 conn(0x7f30a80a8890 msgr2=0x7f30a80a70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:30.564 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 1 -- 10.20.193.77:0/319473754 shutdown_connections 2026-02-17T12:07:30.564 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.555+0000 7f30b0246640 1 -- 10.20.193.77:0/319473754 wait complete. 2026-02-17T12:07:30.572 INFO:tasks.ceph:Scrubbing osd.4 2026-02-17T12:07:30.572 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:07:30.643 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 10 monclient: get_monmap_and_config 2026-02-17T12:07:30.643 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 10 monclient: build_initial_monmap 2026-02-17T12:07:30.644 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 10 monclient: monmap: 2026-02-17T12:07:30.644 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:30.644 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.644 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:30.642152+0000 2026-02-17T12:07:30.644 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:30.642152+0000 2026-02-17T12:07:30.644 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:30.644 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.644 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:30.644 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:30.645 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:30.645 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:30.645 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:30.645 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 1 Processor -- start 2026-02-17T12:07:30.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 1 -- start start 2026-02-17T12:07:30.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 10 monclient: init 2026-02-17T12:07:30.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2026-02-17T12:07:30.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84138100 0x7f1f840a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 10 monclient(hunting): picked mon.noname-b con 0x7f1f84138100 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:30.652 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f1f8409c250 0x7f1f840a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.653 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 10 monclient(hunting): picked mon.noname-c con 0x7f1f8409c250 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:30.653 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f1f84134c00 0x7f1f84135090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.653 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 10 monclient(hunting): picked mon.noname-a con 0x7f1f84134c00 addr v2:10.20.193.77:3300/0 2026-02-17T12:07:30.653 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.653 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1f84138b60 con 0x7f1f84134c00 2026-02-17T12:07:30.653 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.653 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f1f841384e0 con 0x7f1f8409c250 2026-02-17T12:07:30.653 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.653 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1f8409cef0 con 0x7f1f84138100 2026-02-17T12:07:30.653 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.653 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f890f4640 10 monclient(hunting): authenticate will time out at 702.317982s 2026-02-17T12:07:30.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84138100 0x7f1f840a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f83577640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f1f84134c00 0x7f1f84135090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84138100 0x7f1f840a4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:59538/0 (socket says 10.20.193.77:59538) 2026-02-17T12:07:30.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f83577640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f1f84134c00 0x7f1f84135090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:54814/0 (socket says 10.20.193.77:54814) 2026-02-17T12:07:30.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 1 -- 10.20.193.77:0/2753834733 learned_addr learned my addr 10.20.193.77:0/2753834733 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:30.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 10 monclient(hunting): get_auth_request con 0x7f1f84138100 auth_method 0 2026-02-17T12:07:30.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f83577640 10 monclient(hunting): get_auth_request con 0x7f1f84134c00 auth_method 0 2026-02-17T12:07:30.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f83577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.654 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f83577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f83577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82575640 1 --2- 10.20.193.77:0/2753834733 >> v2:10.20.193.119:3300/0 conn(0x7f1f8409c250 0x7f1f840a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f83577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f83577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f83577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82575640 10 monclient(hunting): get_auth_request con 0x7f1f8409c250 auth_method 0 2026-02-17T12:07:30.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.655 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 10 monclient(hunting): handle_auth_done global_id 4499 payload 274 2026-02-17T12:07:30.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 1 -- 10.20.193.77:0/2753834733 >> v2:10.20.193.119:3300/0 conn(0x7f1f8409c250 msgr2=0x7f1f840a4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:30.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 1 --2- 10.20.193.77:0/2753834733 >> v2:10.20.193.119:3300/0 conn(0x7f1f8409c250 0x7f1f840a4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 1 -- 10.20.193.77:0/2753834733 >> v2:10.20.193.77:3300/0 conn(0x7f1f84134c00 msgr2=0x7f1f84135090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:30.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 1 --2- 10.20.193.77:0/2753834733 >> v2:10.20.193.77:3300/0 conn(0x7f1f84134c00 0x7f1f84135090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 1 monclient: found mon.noname-b 2026-02-17T12:07:30.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f82d76640 1 -- 10.20.193.77:0/2753834733 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f84138da0 con 0x7f1f84138100 2026-02-17T12:07:30.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.639+0000 7f1f83577640 1 --2- 10.20.193.77:0/2753834733 >> v2:10.20.193.77:3300/0 conn(0x7f1f84134c00 0x7f1f84135090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:30.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82d76640 1 -- 10.20.193.77:0/2753834733 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84138100 msgr2=0x7f1f840a4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.656 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82d76640 1 --2- 10.20.193.77:0/2753834733 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84138100 0x7f1f840a4a40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f840a8a00 tx=0x7f1f7801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2781d1115982cdbc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.657 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f81d74640 1 -- 10.20.193.77:0/2753834733 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f780af070 con 0x7f1f84138100 2026-02-17T12:07:30.657 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f81d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.657 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f81d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:30.657 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f81d74640 10 monclient: dump: 2026-02-17T12:07:30.657 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.657 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.657 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.657 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.657 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.657 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.657 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.657 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.658 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.658 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.658 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f81d74640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.658 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f81d74640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.658 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f81d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.658 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f81d74640 1 -- 10.20.193.77:0/2753834733 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f78004230 con 0x7f1f84138100 2026-02-17T12:07:30.658 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 5 monclient: authenticate success, global_id 4499 2026-02-17T12:07:30.658 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f81d74640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.658 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f81d74640 1 -- 10.20.193.77:0/2753834733 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f78003720 con 0x7f1f84138100 2026-02-17T12:07:30.658 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f81d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.658 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f81d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:30.658 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f81d74640 10 monclient: dump: 2026-02-17T12:07:30.659 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.659 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.659 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.659 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.659 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.659 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.659 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.659 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.659 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.659 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.659 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:30.659 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 4 set_mon_vals no callback set 2026-02-17T12:07:30.659 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient: shutdown 2026-02-17T12:07:30.660 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:30.660 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 -- 10.20.193.77:0/2753834733 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84138100 msgr2=0x7f1f840a4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.660 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 --2- 10.20.193.77:0/2753834733 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84138100 0x7f1f840a4a40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f840a8a00 tx=0x7f1f7801c560 comp rx=0 tx=0).stop 2026-02-17T12:07:30.660 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 -- 10.20.193.77:0/2753834733 shutdown_connections 2026-02-17T12:07:30.660 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 --2- 10.20.193.77:0/2753834733 >> v2:10.20.193.77:3300/0 conn(0x7f1f84134c00 0x7f1f84135090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.660 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 --2- 10.20.193.77:0/2753834733 >> v2:10.20.193.119:3300/0 conn(0x7f1f8409c250 0x7f1f840a4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.660 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 --2- 10.20.193.77:0/2753834733 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84138100 0x7f1f840a4a40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.660 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 -- 10.20.193.77:0/2753834733 >> 10.20.193.77:0/2753834733 conn(0x7f1f840aae40 msgr2=0x7f1f840ab220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:30.660 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 -- 10.20.193.77:0/2753834733 shutdown_connections 2026-02-17T12:07:30.660 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 -- 10.20.193.77:0/2753834733 wait complete. 2026-02-17T12:07:30.660 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient: build_initial_monmap 2026-02-17T12:07:30.660 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient: monmap: 2026-02-17T12:07:30.661 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:30.661 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:30.661 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:30.661 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:30.661 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:30.661 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.661 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:30.661 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:30.661 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:30.661 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.661 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 Processor -- start 2026-02-17T12:07:30.661 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 -- start start 2026-02-17T12:07:30.662 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient: init 2026-02-17T12:07:30.662 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.662 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:07:30.662 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f8409c250 0x7f1f8413e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.662 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient(hunting): picked mon.noname-b con 0x7f1f8409c250 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:30.662 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84134c00 0x7f1f840a3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.662 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient(hunting): picked mon.noname-c con 0x7f1f84134c00 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:30.662 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f1f84138100 0x7f1f841d2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.662 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient(hunting): picked mon.noname-a con 0x7f1f84138100 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:30.662 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.662 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1f84141dd0 con 0x7f1f84138100 2026-02-17T12:07:30.662 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.663 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1f84141c50 con 0x7f1f8409c250 2026-02-17T12:07:30.663 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.663 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1f84141f50 con 0x7f1f84134c00 2026-02-17T12:07:30.663 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.663 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f890f4640 10 monclient(hunting): authenticate will time out at 702.323473s 2026-02-17T12:07:30.663 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84134c00 0x7f1f840a3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.663 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f83577640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f1f84138100 0x7f1f841d2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.663 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84134c00 0x7f1f840a3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:59544/0 (socket says 10.20.193.77:59544) 2026-02-17T12:07:30.663 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 1 -- 10.20.193.77:0/2144434396 learned_addr learned my addr 10.20.193.77:0/2144434396 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:30.663 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 10 monclient(hunting): get_auth_request con 0x7f1f84134c00 auth_method 0 2026-02-17T12:07:30.663 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.664 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.664 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.664 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f83577640 10 monclient(hunting): get_auth_request con 0x7f1f84138100 auth_method 0 2026-02-17T12:07:30.664 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f83577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.664 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f83577640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.664 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f83577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.664 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82d76640 1 --2- 10.20.193.77:0/2144434396 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f8409c250 0x7f1f8413e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.664 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82d76640 10 monclient(hunting): get_auth_request con 0x7f1f8409c250 auth_method 0 2026-02-17T12:07:30.664 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.664 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.664 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.664 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.665 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.665 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.665 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f83577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.665 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f83577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.665 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f83577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.665 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.665 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.665 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.665 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 10 monclient(hunting): handle_auth_done global_id 4502 payload 824 2026-02-17T12:07:30.665 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 1 -- 10.20.193.77:0/2144434396 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f8409c250 msgr2=0x7f1f8413e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.665 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 1 --2- 10.20.193.77:0/2144434396 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f1f8409c250 0x7f1f8413e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.665 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 1 -- 10.20.193.77:0/2144434396 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f1f84138100 msgr2=0x7f1f841d2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.666 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 1 --2- 10.20.193.77:0/2144434396 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f1f84138100 0x7f1f841d2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.666 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.666 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 1 monclient: found mon.noname-c 2026-02-17T12:07:30.666 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.666 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.666 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f82575640 1 -- 10.20.193.77:0/2144434396 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f840a0960 con 0x7f1f84134c00 2026-02-17T12:07:30.666 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.643+0000 7f1f83577640 1 --2- 10.20.193.77:0/2144434396 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f1f84138100 0x7f1f841d2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:30.669 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f82575640 1 -- 10.20.193.77:0/2144434396 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84134c00 msgr2=0x7f1f840a3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.669 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f82575640 1 --2- 10.20.193.77:0/2144434396 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84134c00 0x7f1f840a3fe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00e7e0 tx=0x7f1f6c00ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.669 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 1 -- 10.20.193.77:0/2144434396 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c017070 con 0x7f1f84134c00 2026-02-17T12:07:30.669 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.669 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:30.669 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 10 monclient: dump: 2026-02-17T12:07:30.669 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.670 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.670 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.670 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.670 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.670 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.670 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.670 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.670 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.670 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.670 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.670 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.670 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.671 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 1 -- 10.20.193.77:0/2144434396 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6c00c8d0 con 0x7f1f84134c00 2026-02-17T12:07:30.671 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.671 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 1 -- 10.20.193.77:0/2144434396 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c00f040 con 0x7f1f84134c00 2026-02-17T12:07:30.671 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.671 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:30.671 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 10 monclient: dump: 2026-02-17T12:07:30.671 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.671 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.671 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.671 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.671 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.671 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.672 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.672 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.672 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.672 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.672 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f81573640 4 set_mon_vals no callback set 2026-02-17T12:07:30.672 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f890f4640 5 monclient: authenticate success, global_id 4502 2026-02-17T12:07:30.672 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f890f4640 10 monclient: _renew_subs 2026-02-17T12:07:30.672 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f890f4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.672 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f890f4640 1 -- 10.20.193.77:0/2144434396 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f84134380 con 0x7f1f84134c00 2026-02-17T12:07:30.672 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f890f4640 10 monclient: _renew_subs 2026-02-17T12:07:30.672 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f890f4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.672 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f890f4640 1 -- 10.20.193.77:0/2144434396 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f8409e040 con 0x7f1f84134c00 2026-02-17T12:07:30.672 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f890f4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.673 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f890f4640 1 -- 10.20.193.77:0/2144434396 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f841348d0 con 0x7f1f84134c00 2026-02-17T12:07:30.673 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 1 -- 10.20.193.77:0/2144434396 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f1f6c012050 con 0x7f1f84134c00 2026-02-17T12:07:30.673 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 1 --2- 10.20.193.77:0/2144434396 >> v2:10.20.193.119:6800/4127986552 conn(0x7f1f5003a120 0x7f1f5003c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.673 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 1 -- 10.20.193.77:0/2144434396 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f1f6c04d610 con 0x7f1f84134c00 2026-02-17T12:07:30.673 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 1 --2- 10.20.193.77:0/2144434396 >> v2:10.20.193.119:6805/4132502681 conn(0x7f1f5003fc30 0x7f1f50042050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.673 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 1 -- 10.20.193.77:0/2144434396 --> v2:10.20.193.119:6805/4132502681 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f6c00ae50 con 0x7f1f5003fc30 2026-02-17T12:07:30.673 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 1 -- 10.20.193.77:0/2144434396 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1f6c054050 con 0x7f1f84134c00 2026-02-17T12:07:30.673 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f637fe640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-17T12:07:30.673 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f82d76640 1 --2- 10.20.193.77:0/2144434396 >> v2:10.20.193.119:6800/4127986552 conn(0x7f1f5003a120 0x7f1f5003c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.673 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f82d76640 10 monclient: get_auth_request con 0x7f1f5003a120 auth_method 0 2026-02-17T12:07:30.673 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f83577640 1 --2- 10.20.193.77:0/2144434396 >> v2:10.20.193.119:6805/4132502681 conn(0x7f1f5003fc30 0x7f1f50042050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.673 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.647+0000 7f1f83577640 10 monclient: get_auth_request con 0x7f1f5003fc30 auth_method 0 2026-02-17T12:07:30.674 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.651+0000 7f1f82d76640 1 --2- 10.20.193.77:0/2144434396 >> v2:10.20.193.119:6800/4127986552 conn(0x7f1f5003a120 0x7f1f5003c5e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1f840a8a00 tx=0x7f1f780a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.674 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.655+0000 7f1f83577640 1 --2- 10.20.193.77:0/2144434396 >> v2:10.20.193.119:6805/4132502681 conn(0x7f1f5003fc30 0x7f1f50042050 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.674 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.655+0000 7f1f637fe640 1 -- 10.20.193.77:0/2144434396 <== osd.4 v2:10.20.193.119:6805/4132502681 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f1f6c00ae50 con 0x7f1f5003fc30 2026-02-17T12:07:30.674 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f890f4640 1 -- 10.20.193.77:0/2144434396 --> v2:10.20.193.119:6805/4132502681 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1f84135090 con 0x7f1f5003fc30 2026-02-17T12:07:30.674 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f637fe640 1 -- 10.20.193.77:0/2144434396 <== osd.4 v2:10.20.193.119:6805/4132502681 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1f84135090 con 0x7f1f5003fc30 2026-02-17T12:07:30.674 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T12:07:30.674 INFO:teuthology.orchestra.run.trial077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:07:30.675 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T12:07:30.676 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f890f4640 1 -- 10.20.193.77:0/2144434396 >> v2:10.20.193.119:6805/4132502681 conn(0x7f1f5003fc30 msgr2=0x7f1f50042050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.677 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f890f4640 1 --2- 10.20.193.77:0/2144434396 >> v2:10.20.193.119:6805/4132502681 conn(0x7f1f5003fc30 0x7f1f50042050 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.677 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f890f4640 1 -- 10.20.193.77:0/2144434396 >> v2:10.20.193.119:6800/4127986552 conn(0x7f1f5003a120 msgr2=0x7f1f5003c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.677 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f890f4640 1 --2- 10.20.193.77:0/2144434396 >> v2:10.20.193.119:6800/4127986552 conn(0x7f1f5003a120 0x7f1f5003c5e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1f840a8a00 tx=0x7f1f780a7000 comp rx=0 tx=0).stop 2026-02-17T12:07:30.677 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f890f4640 10 monclient: shutdown 2026-02-17T12:07:30.677 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f890f4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:30.677 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f890f4640 1 -- 10.20.193.77:0/2144434396 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84134c00 msgr2=0x7f1f840a3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.677 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f890f4640 1 --2- 10.20.193.77:0/2144434396 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f1f84134c00 0x7f1f840a3fe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00e7e0 tx=0x7f1f6c00ebe0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.677 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f83577640 1 -- 10.20.193.77:0/2144434396 reap_dead start 2026-02-17T12:07:30.677 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f890f4640 1 -- 10.20.193.77:0/2144434396 shutdown_connections 2026-02-17T12:07:30.677 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f890f4640 1 -- 10.20.193.77:0/2144434396 >> 10.20.193.77:0/2144434396 conn(0x7f1f840aae40 msgr2=0x7f1f84132b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:30.677 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f890f4640 1 -- 10.20.193.77:0/2144434396 shutdown_connections 2026-02-17T12:07:30.678 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.659+0000 7f1f890f4640 1 -- 10.20.193.77:0/2144434396 wait complete. 2026-02-17T12:07:30.678 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-17T12:07:30.741 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.735+0000 7f9ac396c640 10 monclient: get_monmap_and_config 2026-02-17T12:07:30.742 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.735+0000 7f9ac396c640 10 monclient: build_initial_monmap 2026-02-17T12:07:30.742 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.735+0000 7f9ac396c640 10 monclient: monmap: 2026-02-17T12:07:30.742 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:30.742 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.742 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:30.740431+0000 2026-02-17T12:07:30.742 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:30.740431+0000 2026-02-17T12:07:30.742 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:30.743 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.743 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:30.743 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:30.743 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:30.743 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:30.743 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:30.743 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.745 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.735+0000 7f9ac396c640 1 Processor -- start 2026-02-17T12:07:30.745 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.735+0000 7f9ac396c640 1 -- start start 2026-02-17T12:07:30.746 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.735+0000 7f9ac396c640 10 monclient: init 2026-02-17T12:07:30.746 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac396c640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.746 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac396c640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-17T12:07:30.746 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac396c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9abc09be20 addr v1:10.20.193.119:6789/0 2026-02-17T12:07:30.746 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac396c640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f9abc0a4c20 0x7f9abc13d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.746 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac396c640 10 monclient(hunting): picked mon.noname-c con 0x7f9abc0a4c20 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:30.746 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac396c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9abc0a5070 addr v1:10.20.193.77:6789/0 2026-02-17T12:07:30.746 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac396c640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9abc135530 con 0x7f9abc0a5070 2026-02-17T12:07:30.746 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac396c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9abc09cdf0 con 0x7f9abc09be20 2026-02-17T12:07:30.746 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac396c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.746 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac396c640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9abc09c200 con 0x7f9abc0a4c20 2026-02-17T12:07:30.746 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac396c640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.747 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac396c640 10 monclient(hunting): authenticate will time out at 702.416158s 2026-02-17T12:07:30.747 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac1ee2640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f9abc0a5070 0x7f9abc13f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:51670/0 (socket says 10.20.193.77:51670) 2026-02-17T12:07:30.747 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac1ee2640 1 -- 10.20.193.77:0/4268194894 learned_addr learned my addr 10.20.193.77:0/4268194894 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:07:30.747 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 1 --2- 10.20.193.77:0/4268194894 >> v2:10.20.193.119:3300/0 conn(0x7f9abc0a4c20 0x7f9abc13d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.747 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 10 monclient(hunting): get_auth_request con 0x7f9abc0a4c20 auth_method 0 2026-02-17T12:07:30.747 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.747 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.747 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.747 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.747 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.748 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.748 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 10 monclient(hunting): handle_auth_done global_id 14167 payload 274 2026-02-17T12:07:30.748 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 1 -- 10.20.193.77:0/4268194894 >> v1:10.20.193.119:6789/0 conn(0x7f9abc09be20 legacy=0x7f9abc134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:30.748 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 1 -- 10.20.193.77:0/4268194894 >> v1:10.20.193.77:6789/0 conn(0x7f9abc0a5070 legacy=0x7f9abc13f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:30.748 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.748 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 1 monclient: found mon.noname-c 2026-02-17T12:07:30.748 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.748 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.119:3300/0 2026-02-17T12:07:30.748 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.739+0000 7f9ac0ee0640 1 -- 10.20.193.77:0/4268194894 --> v2:10.20.193.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc09d0d0 con 0x7f9abc0a4c20 2026-02-17T12:07:30.754 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 1 -- 10.20.193.77:0/4268194894 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9abc0a4c20 msgr2=0x7f9abc13d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.754 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 1 --2- 10.20.193.77:0/4268194894 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9abc0a4c20 0x7f9abc13d470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00098c0 tx=0x7f9ab001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=377af31073ec707a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.754 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9aabfff640 1 -- 10.20.193.77:0/4268194894 <== mon.1 v2:10.20.193.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00b1070 con 0x7f9abc0a4c20 2026-02-17T12:07:30.754 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9aabfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.754 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9aabfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:30.755 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9aabfff640 10 monclient: dump: 2026-02-17T12:07:30.755 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.755 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.755 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.755 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.755 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.755 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.755 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.755 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.755 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.755 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.755 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9aabfff640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.756 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9aabfff640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.756 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9aabfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.756 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 5 monclient: authenticate success, global_id 14167 2026-02-17T12:07:30.756 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:30.756 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9aabfff640 1 -- 10.20.193.77:0/4268194894 <== mon.1 v2:10.20.193.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab00ac640 con 0x7f9abc0a4c20 2026-02-17T12:07:30.756 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9aabfff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.756 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9aabfff640 1 -- 10.20.193.77:0/4268194894 <== mon.1 v2:10.20.193.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00aca10 con 0x7f9abc0a4c20 2026-02-17T12:07:30.756 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9aabfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.756 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9aabfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T12:07:30.756 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9aabfff640 10 monclient: dump: 2026-02-17T12:07:30.756 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.756 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.756 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.757 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.757 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.757 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.757 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.757 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.757 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.757 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.757 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:30.757 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 4 set_mon_vals no callback set 2026-02-17T12:07:30.757 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient: shutdown 2026-02-17T12:07:30.757 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:30.757 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 -- 10.20.193.77:0/4268194894 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9abc0a4c20 msgr2=0x7f9abc13d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.758 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 --2- 10.20.193.77:0/4268194894 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9abc0a4c20 0x7f9abc13d470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00098c0 tx=0x7f9ab001c480 comp rx=0 tx=0).stop 2026-02-17T12:07:30.758 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 -- 10.20.193.77:0/4268194894 shutdown_connections 2026-02-17T12:07:30.758 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 --2- 10.20.193.77:0/4268194894 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9abc0a4c20 0x7f9abc13d470 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.758 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 -- 10.20.193.77:0/4268194894 >> 10.20.193.77:0/4268194894 conn(0x7f9abc074ba0 msgr2=0x7f9abc0aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:30.758 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 -- 10.20.193.77:0/4268194894 shutdown_connections 2026-02-17T12:07:30.758 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 -- 10.20.193.77:0/4268194894 wait complete. 2026-02-17T12:07:30.758 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient: build_initial_monmap 2026-02-17T12:07:30.758 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient: monmap: 2026-02-17T12:07:30.758 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:30.758 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:30.758 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:30.758 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:30.758 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:30.759 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.759 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:30.759 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:30.759 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:30.759 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.759 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 Processor -- start 2026-02-17T12:07:30.759 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 -- start start 2026-02-17T12:07:30.759 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient: init 2026-02-17T12:07:30.759 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.759 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:07:30.759 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9abc09be20 0x7f9abc0a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.759 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient(hunting): picked mon.noname-b con 0x7f9abc09be20 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:30.759 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9abc0a4c20 0x7f9abc0a2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient(hunting): picked mon.noname-c con 0x7f9abc0a4c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:30.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9abc0a5070 0x7f9abc0a3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient(hunting): picked mon.noname-a con 0x7f9abc0a5070 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:30.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc143c90 con 0x7f9abc0a5070 2026-02-17T12:07:30.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc143b10 con 0x7f9abc09be20 2026-02-17T12:07:30.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9abc143e10 con 0x7f9abc0a4c20 2026-02-17T12:07:30.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac396c640 10 monclient(hunting): authenticate will time out at 702.422254s 2026-02-17T12:07:30.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac1ee2640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9abc0a5070 0x7f9abc0a3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.760 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9abc0a4c20 0x7f9abc0a2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac1ee2640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9abc0a5070 0x7f9abc0a3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:54838/0 (socket says 10.20.193.77:54838) 2026-02-17T12:07:30.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 10 monclient(hunting): get_auth_request con 0x7f9abc0a4c20 auth_method 0 2026-02-17T12:07:30.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac1ee2640 1 -- 10.20.193.77:0/10311849 learned_addr learned my addr 10.20.193.77:0/10311849 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:30.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac1ee2640 10 monclient(hunting): get_auth_request con 0x7f9abc0a5070 auth_method 0 2026-02-17T12:07:30.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac1ee2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac1ee2640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac1ee2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.761 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac16e1640 1 --2- 10.20.193.77:0/10311849 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9abc09be20 0x7f9abc0a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.762 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.762 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.762 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.762 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac1ee2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.762 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac1ee2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.762 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac1ee2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.762 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac16e1640 10 monclient(hunting): get_auth_request con 0x7f9abc09be20 auth_method 0 2026-02-17T12:07:30.762 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac16e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.762 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac16e1640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.762 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac16e1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.762 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 10 monclient(hunting): handle_auth_done global_id 4505 payload 824 2026-02-17T12:07:30.763 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 1 -- 10.20.193.77:0/10311849 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9abc09be20 msgr2=0x7f9abc0a2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.763 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 1 --2- 10.20.193.77:0/10311849 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9abc09be20 0x7f9abc0a2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.763 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 1 -- 10.20.193.77:0/10311849 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9abc0a5070 msgr2=0x7f9abc0a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.763 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 1 --2- 10.20.193.77:0/10311849 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9abc0a5070 0x7f9abc0a3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.763 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.763 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 1 monclient: found mon.noname-c 2026-02-17T12:07:30.763 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.763 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.763 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac0ee0640 1 -- 10.20.193.77:0/10311849 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc13ad10 con 0x7f9abc0a4c20 2026-02-17T12:07:30.763 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac1ee2640 1 --2- 10.20.193.77:0/10311849 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9abc0a5070 0x7f9abc0a3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:30.763 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.743+0000 7f9ac16e1640 1 --2- 10.20.193.77:0/10311849 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9abc09be20 0x7f9abc0a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:07:30.764 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac0ee0640 1 -- 10.20.193.77:0/10311849 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9abc0a4c20 msgr2=0x7f9abc0a2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.764 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac0ee0640 1 --2- 10.20.193.77:0/10311849 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9abc0a4c20 0x7f9abc0a2fd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00ab000 tx=0x7f9ab001acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.764 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 1 -- 10.20.193.77:0/10311849 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00b1050 con 0x7f9abc0a4c20 2026-02-17T12:07:30.764 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.764 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:30.764 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 10 monclient: dump: 2026-02-17T12:07:30.764 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.764 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.764 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.764 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.764 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.764 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.764 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.765 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.765 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.765 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.765 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.765 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.765 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.765 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 1 -- 10.20.193.77:0/10311849 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab00b2040 con 0x7f9abc0a4c20 2026-02-17T12:07:30.765 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.765 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 1 -- 10.20.193.77:0/10311849 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00aaa90 con 0x7f9abc0a4c20 2026-02-17T12:07:30.765 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.765 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:30.765 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 10 monclient: dump: 2026-02-17T12:07:30.765 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.766 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.766 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.766 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.766 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.766 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.766 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.766 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.766 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.766 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.766 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac396c640 5 monclient: authenticate success, global_id 4505 2026-02-17T12:07:30.766 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac396c640 10 monclient: _renew_subs 2026-02-17T12:07:30.766 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aab7fe640 4 set_mon_vals no callback set 2026-02-17T12:07:30.767 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac396c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.767 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac396c640 1 -- 10.20.193.77:0/10311849 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9abc140ed0 con 0x7f9abc0a4c20 2026-02-17T12:07:30.767 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac396c640 10 monclient: _renew_subs 2026-02-17T12:07:30.767 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac396c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.767 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac396c640 1 -- 10.20.193.77:0/10311849 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9abc0aa2a0 con 0x7f9abc0a4c20 2026-02-17T12:07:30.767 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac396c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:30.767 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac396c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:30.767 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac396c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.767 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac396c640 1 -- 10.20.193.77:0/10311849 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9abc0a46f0 con 0x7f9abc0a4c20 2026-02-17T12:07:30.767 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 1 -- 10.20.193.77:0/10311849 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f9ab00b8450 con 0x7f9abc0a4c20 2026-02-17T12:07:30.767 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 1 --2- 10.20.193.77:0/10311849 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9a8c03a170 0x7f9a8c03c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.767 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9aa9ffb640 1 -- 10.20.193.77:0/10311849 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f9ab00e7e60 con 0x7f9abc0a4c20 2026-02-17T12:07:30.767 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac16e1640 1 --2- 10.20.193.77:0/10311849 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9a8c03a170 0x7f9a8c03c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.768 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.747+0000 7f9ac16e1640 10 monclient: get_auth_request con 0x7f9a8c03a170 auth_method 0 2026-02-17T12:07:30.768 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.751+0000 7f9ac16e1640 1 --2- 10.20.193.77:0/10311849 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9a8c03a170 0x7f9a8c03c630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0099b0 tx=0x7f9aac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.768 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.751+0000 7f9aa9ffb640 1 -- 10.20.193.77:0/10311849 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f9abc0a46f0 con 0x7f9abc0a4c20 2026-02-17T12:07:30.768 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.751+0000 7f9aa9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:30.769 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.751+0000 7f9aa9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:30.830 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.823+0000 7f9ac396c640 1 -- 10.20.193.77:0/10311849 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f9abc134e00 con 0x7f9a8c03a170 2026-02-17T12:07:30.831 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9aa9ffb640 1 -- 10.20.193.77:0/10311849 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9abc134e00 con 0x7f9a8c03a170 2026-02-17T12:07:30.831 INFO:teuthology.orchestra.run.trial077.stderr:instructed osd(s) 4 to deep-scrub 2026-02-17T12:07:30.832 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9ac396c640 1 -- 10.20.193.77:0/10311849 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9a8c03a170 msgr2=0x7f9a8c03c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.832 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9ac396c640 1 --2- 10.20.193.77:0/10311849 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9a8c03a170 0x7f9a8c03c630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0099b0 tx=0x7f9aac008040 comp rx=0 tx=0).stop 2026-02-17T12:07:30.832 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9ac396c640 10 monclient: shutdown 2026-02-17T12:07:30.832 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9ac396c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:30.832 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9ac396c640 1 -- 10.20.193.77:0/10311849 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9abc0a4c20 msgr2=0x7f9abc0a2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.832 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9ac396c640 1 --2- 10.20.193.77:0/10311849 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9abc0a4c20 0x7f9abc0a2fd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00ab000 tx=0x7f9ab001acc0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.832 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9ac396c640 1 -- 10.20.193.77:0/10311849 shutdown_connections 2026-02-17T12:07:30.832 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9ac396c640 1 --2- 10.20.193.77:0/10311849 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9a8c03a170 0x7f9a8c03c630 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.833 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9ac396c640 1 --2- 10.20.193.77:0/10311849 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9abc0a5070 0x7f9abc0a3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.833 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9ac396c640 1 --2- 10.20.193.77:0/10311849 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9abc0a4c20 0x7f9abc0a2fd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.833 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9ac396c640 1 --2- 10.20.193.77:0/10311849 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9abc09be20 0x7f9abc0a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.833 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9ac396c640 1 -- 10.20.193.77:0/10311849 >> 10.20.193.77:0/10311849 conn(0x7f9abc074ba0 msgr2=0x7f9abc138080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:30.833 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9ac396c640 1 -- 10.20.193.77:0/10311849 shutdown_connections 2026-02-17T12:07:30.833 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.827+0000 7f9ac396c640 1 -- 10.20.193.77:0/10311849 wait complete. 2026-02-17T12:07:30.841 INFO:tasks.ceph:Scrubbing osd.5 2026-02-17T12:07:30.841 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:07:30.908 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 10 monclient: get_monmap_and_config 2026-02-17T12:07:30.908 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 10 monclient: build_initial_monmap 2026-02-17T12:07:30.908 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 10 monclient: monmap: 2026-02-17T12:07:30.908 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:30.908 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.908 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:30.904082+0000 2026-02-17T12:07:30.908 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:30.904082+0000 2026-02-17T12:07:30.909 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:30.909 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.909 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:30.909 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:30.909 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:30.909 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:30.909 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:30.909 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.909 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 1 Processor -- start 2026-02-17T12:07:30.909 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 1 -- start start 2026-02-17T12:07:30.909 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 10 monclient: init 2026-02-17T12:07:30.909 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.910 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 10 monclient: _add_conns ranks=[4,2,1,0,3] 2026-02-17T12:07:30.910 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f6fb00a21a0 0x7f6fb0138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.910 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 10 monclient(hunting): picked mon.noname-c con 0x7f6fb00a21a0 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:30.910 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb009ceb0 0x7f6fb009d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.910 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 10 monclient(hunting): picked mon.noname-b con 0x7f6fb009ceb0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:30.910 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6fb0073be0 addr v1:10.20.193.119:6789/0 2026-02-17T12:07:30.910 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb01388d0 con 0x7f6fb0073be0 2026-02-17T12:07:30.910 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.910 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f6fb00a3ff0 con 0x7f6fb00a21a0 2026-02-17T12:07:30.910 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.911 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb009b980 con 0x7f6fb009ceb0 2026-02-17T12:07:30.911 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.911 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb7573640 10 monclient(hunting): authenticate will time out at 702.579571s 2026-02-17T12:07:30.911 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb4ae7640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb009ceb0 0x7f6fb009d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.911 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb4ae7640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb009ceb0 0x7f6fb009d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:59558/0 (socket says 10.20.193.77:59558) 2026-02-17T12:07:30.911 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb52e8640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f6fb00a21a0 0x7f6fb0138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.911 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb4ae7640 1 -- 10.20.193.77:0/1691093499 learned_addr learned my addr 10.20.193.77:0/1691093499 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:30.911 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb4ae7640 10 monclient(hunting): get_auth_request con 0x7f6fb009ceb0 auth_method 0 2026-02-17T12:07:30.911 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb4ae7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.911 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb4ae7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.912 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb4ae7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.912 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb52e8640 10 monclient(hunting): get_auth_request con 0x7f6fb00a21a0 auth_method 0 2026-02-17T12:07:30.912 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb52e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.912 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb52e8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.912 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb52e8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.912 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb4ae7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.912 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb4ae7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.912 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb4ae7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.912 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb52e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.912 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb52e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.913 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb52e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.913 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb4ae7640 10 monclient(hunting): handle_auth_done global_id 4508 payload 274 2026-02-17T12:07:30.913 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb4ae7640 1 -- 10.20.193.77:0/1691093499 >> v2:10.20.193.119:3300/0 conn(0x7f6fb00a21a0 msgr2=0x7f6fb0138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:30.913 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb4ae7640 1 --2- 10.20.193.77:0/1691093499 >> v2:10.20.193.119:3300/0 conn(0x7f6fb00a21a0 0x7f6fb0138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.913 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.899+0000 7f6fb4ae7640 1 -- 10.20.193.77:0/1691093499 >> v1:10.20.193.119:6789/0 conn(0x7f6fb0073be0 legacy=0x7f6fb0074070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:30.913 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.903+0000 7f6fb4ae7640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.913 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.903+0000 7f6fb4ae7640 1 monclient: found mon.noname-b 2026-02-17T12:07:30.913 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.903+0000 7f6fb4ae7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.913 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.903+0000 7f6fb4ae7640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.913 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.903+0000 7f6fb4ae7640 1 -- 10.20.193.77:0/1691093499 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb009b6a0 con 0x7f6fb009ceb0 2026-02-17T12:07:30.920 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.903+0000 7f6fb4ae7640 1 -- 10.20.193.77:0/1691093499 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb009ceb0 msgr2=0x7f6fb009d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.920 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.903+0000 7f6fb4ae7640 1 --2- 10.20.193.77:0/1691093499 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb009ceb0 0x7f6fb009d2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009970 tx=0x7f6fa401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b336cfa25a1af17e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.920 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9ffff640 1 -- 10.20.193.77:0/1691093499 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4004030 con 0x7f6fb009ceb0 2026-02-17T12:07:30.920 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.920 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T12:07:30.920 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9ffff640 10 monclient: dump: 2026-02-17T12:07:30.920 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.920 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.920 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.921 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.921 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.921 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.921 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.921 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.921 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.921 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9ffff640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9ffff640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9ffff640 1 -- 10.20.193.77:0/1691093499 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa40041d0 con 0x7f6fb009ceb0 2026-02-17T12:07:30.921 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9ffff640 1 -- 10.20.193.77:0/1691093499 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa40045a0 con 0x7f6fb009ceb0 2026-02-17T12:07:30.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 5 monclient: authenticate success, global_id 4508 2026-02-17T12:07:30.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:30.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 4 set_mon_vals no callback set 2026-02-17T12:07:30.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:30.922 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9ffff640 10 monclient: dump: 2026-02-17T12:07:30.922 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.922 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.922 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.922 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.922 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.923 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.923 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.923 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.923 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.923 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient: shutdown 2026-02-17T12:07:30.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:30.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 -- 10.20.193.77:0/1691093499 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb009ceb0 msgr2=0x7f6fb009d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 --2- 10.20.193.77:0/1691093499 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb009ceb0 0x7f6fb009d2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009970 tx=0x7f6fa401c540 comp rx=0 tx=0).stop 2026-02-17T12:07:30.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 -- 10.20.193.77:0/1691093499 shutdown_connections 2026-02-17T12:07:30.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 --2- 10.20.193.77:0/1691093499 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb009ceb0 0x7f6fb009d2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 --2- 10.20.193.77:0/1691093499 >> v2:10.20.193.119:3300/0 conn(0x7f6fb00a21a0 0x7f6fb0138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.923 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 -- 10.20.193.77:0/1691093499 >> 10.20.193.77:0/1691093499 conn(0x7f6fb00a7420 msgr2=0x7f6fb00a3290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:30.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 -- 10.20.193.77:0/1691093499 shutdown_connections 2026-02-17T12:07:30.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 -- 10.20.193.77:0/1691093499 wait complete. 2026-02-17T12:07:30.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient: build_initial_monmap 2026-02-17T12:07:30.924 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient: monmap: 2026-02-17T12:07:30.924 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:30.924 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:30.924 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:30.924 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:30.924 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:30.924 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.924 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:30.924 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:30.925 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:30.925 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 Processor -- start 2026-02-17T12:07:30.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 -- start start 2026-02-17T12:07:30.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient: init 2026-02-17T12:07:30.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:30.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:07:30.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f6fb0073be0 0x7f6fb01d24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient(hunting): picked mon.noname-a con 0x7f6fb0073be0 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:30.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6fb009ceb0 0x7f6fb013f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient(hunting): picked mon.noname-b con 0x7f6fb009ceb0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:30.925 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb00a21a0 0x7f6fb013fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.926 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient(hunting): picked mon.noname-c con 0x7f6fb00a21a0 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:30.926 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.926 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb0142f50 con 0x7f6fb0073be0 2026-02-17T12:07:30.926 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.926 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb0142dd0 con 0x7f6fb009ceb0 2026-02-17T12:07:30.926 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:30.926 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb01430d0 con 0x7f6fb00a21a0 2026-02-17T12:07:30.926 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:30.926 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient(hunting): authenticate will time out at 702.585152s 2026-02-17T12:07:30.926 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb00a21a0 0x7f6fb013fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.926 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb52e8640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f6fb0073be0 0x7f6fb01d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.926 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb00a21a0 0x7f6fb013fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:59570/0 (socket says 10.20.193.77:59570) 2026-02-17T12:07:30.927 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 1 -- 10.20.193.77:0/3570428776 learned_addr learned my addr 10.20.193.77:0/3570428776 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:30.927 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 10 monclient(hunting): get_auth_request con 0x7f6fb00a21a0 auth_method 0 2026-02-17T12:07:30.927 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.927 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.927 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.927 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb52e8640 10 monclient(hunting): get_auth_request con 0x7f6fb0073be0 auth_method 0 2026-02-17T12:07:30.927 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb52e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.927 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb52e8640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.927 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb52e8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.927 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.927 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.927 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.928 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb52e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:30.928 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb52e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:30.928 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb52e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:30.928 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb4ae7640 1 --2- 10.20.193.77:0/3570428776 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6fb009ceb0 0x7f6fb013f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.928 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb4ae7640 10 monclient(hunting): get_auth_request con 0x7f6fb009ceb0 auth_method 0 2026-02-17T12:07:30.928 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb4ae7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:30.928 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb4ae7640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:30.928 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb4ae7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:30.928 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 10 monclient(hunting): handle_auth_done global_id 4511 payload 824 2026-02-17T12:07:30.928 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 1 -- 10.20.193.77:0/3570428776 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6fb009ceb0 msgr2=0x7f6fb013f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.928 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 1 --2- 10.20.193.77:0/3570428776 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f6fb009ceb0 0x7f6fb013f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.928 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 1 -- 10.20.193.77:0/3570428776 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f6fb0073be0 msgr2=0x7f6fb01d24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:30.928 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 1 --2- 10.20.193.77:0/3570428776 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f6fb0073be0 0x7f6fb01d24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:30.929 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 10 monclient: _finish_hunting 0 2026-02-17T12:07:30.929 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 1 monclient: found mon.noname-c 2026-02-17T12:07:30.929 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:30.929 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.929 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 1 -- 10.20.193.77:0/3570428776 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb01d29e0 con 0x7f6fb00a21a0 2026-02-17T12:07:30.929 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb52e8640 1 --2- 10.20.193.77:0/3570428776 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f6fb0073be0 0x7f6fb01d24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:30.929 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 1 -- 10.20.193.77:0/3570428776 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb00a21a0 msgr2=0x7f6fb013fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:30.929 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb5ae9640 1 --2- 10.20.193.77:0/3570428776 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb00a21a0 0x7f6fb013fbc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00b970 tx=0x7f6fac00be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:30.929 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9dffb640 1 -- 10.20.193.77:0/3570428776 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00c930 con 0x7f6fb00a21a0 2026-02-17T12:07:30.929 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.929 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:30.929 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9dffb640 10 monclient: dump: 2026-02-17T12:07:30.930 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.930 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.930 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.930 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.930 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.930 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.930 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.930 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.930 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.930 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.930 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9dffb640 10 monclient: _finish_auth 0 2026-02-17T12:07:30.930 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9dffb640 10 monclient: _check_auth_tickets 2026-02-17T12:07:30.931 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:30.931 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9dffb640 1 -- 10.20.193.77:0/3570428776 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fac010070 con 0x7f6fb00a21a0 2026-02-17T12:07:30.931 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:30.931 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9dffb640 1 -- 10.20.193.77:0/3570428776 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00cd50 con 0x7f6fb00a21a0 2026-02-17T12:07:30.931 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:30.931 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:30.931 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9dffb640 10 monclient: dump: 2026-02-17T12:07:30.931 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:30.931 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:30.931 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.931 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:30.931 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:30.931 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:30.932 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:30.932 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:30.932 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:30.932 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:30.932 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6f9f7fe640 4 set_mon_vals no callback set 2026-02-17T12:07:30.932 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 5 monclient: authenticate success, global_id 4511 2026-02-17T12:07:30.932 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient: _renew_subs 2026-02-17T12:07:30.932 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.932 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 -- 10.20.193.77:0/3570428776 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb00a5650 con 0x7f6fb00a21a0 2026-02-17T12:07:30.932 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient: _renew_subs 2026-02-17T12:07:30.932 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.932 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.907+0000 7f6fb7573640 1 -- 10.20.193.77:0/3570428776 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb013dbb0 con 0x7f6fb00a21a0 2026-02-17T12:07:30.932 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6fb7573640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:30.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6fb7573640 1 -- 10.20.193.77:0/3570428776 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6fb0137da0 con 0x7f6fb00a21a0 2026-02-17T12:07:30.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6f9dffb640 1 -- 10.20.193.77:0/3570428776 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f6fac004070 con 0x7f6fb00a21a0 2026-02-17T12:07:30.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6f9dffb640 1 --2- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6800/4127986552 conn(0x7f6f8003a120 0x7f6f8003c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6f9dffb640 1 -- 10.20.193.77:0/3570428776 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f6fac04d800 con 0x7f6fb00a21a0 2026-02-17T12:07:30.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6f9dffb640 1 --2- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6809/3174335982 conn(0x7f6f8003fbc0 0x7f6f80041fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:30.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6f9dffb640 1 -- 10.20.193.77:0/3570428776 --> v2:10.20.193.119:6809/3174335982 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f80042650 con 0x7f6f8003fbc0 2026-02-17T12:07:30.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6f9dffb640 1 -- 10.20.193.77:0/3570428776 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6fac054050 con 0x7f6fb00a21a0 2026-02-17T12:07:30.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6f9dffb640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-17T12:07:30.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6fb52e8640 1 --2- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6800/4127986552 conn(0x7f6f8003a120 0x7f6f8003c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6fb52e8640 10 monclient: get_auth_request con 0x7f6f8003a120 auth_method 0 2026-02-17T12:07:30.933 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6fb4ae7640 1 --2- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6809/3174335982 conn(0x7f6f8003fbc0 0x7f6f80041fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:30.934 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6fb4ae7640 10 monclient: get_auth_request con 0x7f6f8003fbc0 auth_method 0 2026-02-17T12:07:30.934 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6fb4ae7640 1 -- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6809/3174335982 conn(0x7f6f8003fbc0 msgr2=0x7f6f80041fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-17T12:07:30.934 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6fb4ae7640 1 -- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6809/3174335982 conn(0x7f6f8003fbc0 msgr2=0x7f6f80041fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T12:07:30.934 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6fb4ae7640 1 --2- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6809/3174335982 conn(0x7f6f8003fbc0 0x7f6f80041fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T12:07:30.934 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6fb4ae7640 1 --2- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6809/3174335982 conn(0x7f6f8003fbc0 0x7f6f80041fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:07:30.934 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:30.911+0000 7f6fb52e8640 1 --2- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6800/4127986552 conn(0x7f6f8003a120 0x7f6f8003c5e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0011310 tx=0x7f6fa0009290 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:31.116 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.111+0000 7f6fb4ae7640 1 --2- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6809/3174335982 conn(0x7f6f8003fbc0 0x7f6f80041fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:31.116 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.111+0000 7f6fb4ae7640 10 monclient: get_auth_request con 0x7f6f8003fbc0 auth_method 0 2026-02-17T12:07:31.120 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.115+0000 7f6fb4ae7640 1 --2- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6809/3174335982 conn(0x7f6f8003fbc0 0x7f6f80041fe0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:31.121 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.115+0000 7f6f9dffb640 1 -- 10.20.193.77:0/3570428776 <== osd.5 v2:10.20.193.119:6809/3174335982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f6f80042650 con 0x7f6f8003fbc0 2026-02-17T12:07:31.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6fb7573640 1 -- 10.20.193.77:0/3570428776 --> v2:10.20.193.119:6809/3174335982 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6fb009d2f0 con 0x7f6f8003fbc0 2026-02-17T12:07:31.128 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6f9dffb640 1 -- 10.20.193.77:0/3570428776 <== osd.5 v2:10.20.193.119:6809/3174335982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6fb009d2f0 con 0x7f6f8003fbc0 2026-02-17T12:07:31.129 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T12:07:31.129 INFO:teuthology.orchestra.run.trial077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:07:31.129 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T12:07:31.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6fb7573640 1 -- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6809/3174335982 conn(0x7f6f8003fbc0 msgr2=0x7f6f80041fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:31.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6fb7573640 1 --2- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6809/3174335982 conn(0x7f6f8003fbc0 0x7f6f80041fe0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:31.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6fb7573640 1 -- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6800/4127986552 conn(0x7f6f8003a120 msgr2=0x7f6f8003c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:31.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6fb7573640 1 --2- 10.20.193.77:0/3570428776 >> v2:10.20.193.119:6800/4127986552 conn(0x7f6f8003a120 0x7f6f8003c5e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0011310 tx=0x7f6fa0009290 comp rx=0 tx=0).stop 2026-02-17T12:07:31.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6fb7573640 10 monclient: shutdown 2026-02-17T12:07:31.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6fb7573640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:31.130 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6fb7573640 1 -- 10.20.193.77:0/3570428776 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb00a21a0 msgr2=0x7f6fb013fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:31.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6fb7573640 1 --2- 10.20.193.77:0/3570428776 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f6fb00a21a0 0x7f6fb013fbc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00b970 tx=0x7f6fac00be30 comp rx=0 tx=0).stop 2026-02-17T12:07:31.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6fb5ae9640 1 -- 10.20.193.77:0/3570428776 reap_dead start 2026-02-17T12:07:31.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6fb7573640 1 -- 10.20.193.77:0/3570428776 shutdown_connections 2026-02-17T12:07:31.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6fb7573640 1 -- 10.20.193.77:0/3570428776 >> 10.20.193.77:0/3570428776 conn(0x7f6fb00a7420 msgr2=0x7f6fb0099670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:31.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6fb7573640 1 -- 10.20.193.77:0/3570428776 shutdown_connections 2026-02-17T12:07:31.131 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.123+0000 7f6fb7573640 1 -- 10.20.193.77:0/3570428776 wait complete. 2026-02-17T12:07:31.138 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-17T12:07:31.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.199+0000 7f57dbe00640 10 monclient: get_monmap_and_config 2026-02-17T12:07:31.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.199+0000 7f57dbe00640 10 monclient: build_initial_monmap 2026-02-17T12:07:31.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.199+0000 7f57dbe00640 10 monclient: monmap: 2026-02-17T12:07:31.209 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:31.210 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:31.210 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:31.205295+0000 2026-02-17T12:07:31.210 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:31.205295+0000 2026-02-17T12:07:31.210 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:31.210 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:31.210 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:31.210 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:31.210 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:31.210 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:31.210 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:31.210 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:31.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 1 Processor -- start 2026-02-17T12:07:31.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 1 -- start start 2026-02-17T12:07:31.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 10 monclient: init 2026-02-17T12:07:31.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:31.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2026-02-17T12:07:31.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f57d40a07d0 0x7f57d40a2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:31.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 10 monclient(hunting): picked mon.noname-a con 0x7f57d40a07d0 addr v2:10.20.193.77:3300/0 2026-02-17T12:07:31.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f57d40a2750 0x7f57d40a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:31.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 10 monclient(hunting): picked mon.noname-b con 0x7f57d40a2750 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:31.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f57d413a990 0x7f57d413cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:31.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 10 monclient(hunting): picked mon.noname-c con 0x7f57d413a990 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:31.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:31.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f57d409ed40 con 0x7f57d40a07d0 2026-02-17T12:07:31.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:31.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f57d40a3070 con 0x7f57d413a990 2026-02-17T12:07:31.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:31.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f57d409d4a0 con 0x7f57d40a2750 2026-02-17T12:07:31.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:31.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57dbe00640 10 monclient(hunting): authenticate will time out at 702.880673s 2026-02-17T12:07:31.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f57d40a07d0 0x7f57d40a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:31.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9374640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f57d40a2750 0x7f57d40a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:31.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f57d40a07d0 0x7f57d40a2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:54850/0 (socket says 10.20.193.77:54850) 2026-02-17T12:07:31.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 1 -- 10.20.193.77:0/347247754 learned_addr learned my addr 10.20.193.77:0/347247754 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:31.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 10 monclient(hunting): get_auth_request con 0x7f57d40a07d0 auth_method 0 2026-02-17T12:07:31.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:31.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:31.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:31.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9374640 10 monclient(hunting): get_auth_request con 0x7f57d40a2750 auth_method 0 2026-02-17T12:07:31.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9374640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:31.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9374640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:31.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9374640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:31.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:31.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:31.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57da376640 1 --2- 10.20.193.77:0/347247754 >> v2:10.20.193.119:3300/0 conn(0x7f57d413a990 0x7f57d413cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:31.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:31.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57da376640 10 monclient(hunting): get_auth_request con 0x7f57d413a990 auth_method 0 2026-02-17T12:07:31.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57da376640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:31.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57da376640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:31.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57da376640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:31.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9374640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:31.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9374640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:31.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9374640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:31.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 10 monclient(hunting): handle_auth_done global_id 4524 payload 274 2026-02-17T12:07:31.214 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 1 -- 10.20.193.77:0/347247754 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f57d40a2750 msgr2=0x7f57d40a2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:31.215 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 1 --2- 10.20.193.77:0/347247754 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f57d40a2750 0x7f57d40a2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:31.215 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 1 -- 10.20.193.77:0/347247754 >> v2:10.20.193.119:3300/0 conn(0x7f57d413a990 msgr2=0x7f57d413cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:31.215 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 1 --2- 10.20.193.77:0/347247754 >> v2:10.20.193.119:3300/0 conn(0x7f57d413a990 0x7f57d413cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:31.215 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 10 monclient: _finish_hunting 0 2026-02-17T12:07:31.215 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 1 monclient: found mon.noname-a 2026-02-17T12:07:31.215 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:31.215 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:31.215 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9b75640 1 -- 10.20.193.77:0/347247754 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d409ea60 con 0x7f57d40a07d0 2026-02-17T12:07:31.215 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57d9374640 1 --2- 10.20.193.77:0/347247754 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f57d40a2750 0x7f57d40a2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:31.215 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.203+0000 7f57da376640 1 --2- 10.20.193.77:0/347247754 >> v2:10.20.193.119:3300/0 conn(0x7f57d413a990 0x7f57d413cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T12:07:31.222 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9b75640 1 -- 10.20.193.77:0/347247754 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f57d40a07d0 msgr2=0x7f57d40a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:31.222 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9b75640 1 --2- 10.20.193.77:0/347247754 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f57d40a07d0 0x7f57d40a2210 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f57d409d180 tx=0x7f57c401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ae4febc34aef30 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:31.222 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d8b73640 1 -- 10.20.193.77:0/347247754 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c40b1070 con 0x7f57d40a07d0 2026-02-17T12:07:31.222 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d8b73640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:31.222 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d8b73640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:31.223 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d8b73640 10 monclient: dump: 2026-02-17T12:07:31.223 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:31.223 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:31.223 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:31.223 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:31.223 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:31.223 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:31.223 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:31.223 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:31.223 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:31.223 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:31.223 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d8b73640 10 monclient: _finish_auth 0 2026-02-17T12:07:31.224 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d8b73640 10 monclient: _check_auth_tickets 2026-02-17T12:07:31.224 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d8b73640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:31.224 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d8b73640 1 -- 10.20.193.77:0/347247754 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c4004230 con 0x7f57d40a07d0 2026-02-17T12:07:31.224 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d8b73640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:31.224 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d8b73640 1 -- 10.20.193.77:0/347247754 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c40a8050 con 0x7f57d40a07d0 2026-02-17T12:07:31.224 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 5 monclient: authenticate success, global_id 4524 2026-02-17T12:07:31.224 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:31.224 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 4 set_mon_vals no callback set 2026-02-17T12:07:31.224 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d8b73640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:31.224 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d8b73640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:31.224 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d8b73640 10 monclient: dump: 2026-02-17T12:07:31.224 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:31.225 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:31.225 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:31.225 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:31.225 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:31.225 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:31.225 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:31.225 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:31.225 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:31.225 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:31.225 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient: shutdown 2026-02-17T12:07:31.225 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:31.225 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 -- 10.20.193.77:0/347247754 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f57d40a07d0 msgr2=0x7f57d40a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:31.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 --2- 10.20.193.77:0/347247754 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f57d40a07d0 0x7f57d40a2210 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f57d409d180 tx=0x7f57c401c500 comp rx=0 tx=0).stop 2026-02-17T12:07:31.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 -- 10.20.193.77:0/347247754 shutdown_connections 2026-02-17T12:07:31.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 --2- 10.20.193.77:0/347247754 >> v2:10.20.193.119:3300/0 conn(0x7f57d413a990 0x7f57d413cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:31.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 --2- 10.20.193.77:0/347247754 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f57d40a2750 0x7f57d40a2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:31.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 --2- 10.20.193.77:0/347247754 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f57d40a07d0 0x7f57d40a2210 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:31.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 -- 10.20.193.77:0/347247754 >> 10.20.193.77:0/347247754 conn(0x7f57d40a73c0 msgr2=0x7f57d40a3300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:31.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 -- 10.20.193.77:0/347247754 shutdown_connections 2026-02-17T12:07:31.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 -- 10.20.193.77:0/347247754 wait complete. 2026-02-17T12:07:31.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient: build_initial_monmap 2026-02-17T12:07:31.226 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient: monmap: 2026-02-17T12:07:31.226 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:31.226 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:31.227 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:31.227 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:31.227 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:31.227 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:31.227 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:31.227 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:31.227 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:31.227 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:31.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 Processor -- start 2026-02-17T12:07:31.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 -- start start 2026-02-17T12:07:31.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient: init 2026-02-17T12:07:31.227 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:31.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T12:07:31.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f57d40a07d0 0x7f57d4096f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:31.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient(hunting): picked mon.noname-b con 0x7f57d40a07d0 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:31.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f57d40a2750 0x7f57d4073c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:31.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient(hunting): picked mon.noname-c con 0x7f57d40a2750 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:31.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f57d413a990 0x7f57d4072040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:31.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient(hunting): picked mon.noname-a con 0x7f57d413a990 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:31.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:31.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f57d40a0d30 con 0x7f57d413a990 2026-02-17T12:07:31.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:31.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f57d40a0bb0 con 0x7f57d40a07d0 2026-02-17T12:07:31.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:31.228 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f57d409f720 con 0x7f57d40a2750 2026-02-17T12:07:31.229 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:31.229 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57dbe00640 10 monclient(hunting): authenticate will time out at 702.886098s 2026-02-17T12:07:31.229 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f57d413a990 0x7f57d4072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:31.229 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9374640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f57d40a2750 0x7f57d4073c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:31.229 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f57d413a990 0x7f57d4072040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:54864/0 (socket says 10.20.193.77:54864) 2026-02-17T12:07:31.229 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 1 -- 10.20.193.77:0/2619505824 learned_addr learned my addr 10.20.193.77:0/2619505824 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:31.229 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 10 monclient(hunting): get_auth_request con 0x7f57d413a990 auth_method 0 2026-02-17T12:07:31.229 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:31.229 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:31.229 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:31.229 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9374640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f57d40a2750 0x7f57d4073c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:59596/0 (socket says 10.20.193.77:59596) 2026-02-17T12:07:31.230 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9374640 10 monclient(hunting): get_auth_request con 0x7f57d40a2750 auth_method 0 2026-02-17T12:07:31.230 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9374640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:31.230 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9374640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:31.230 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9374640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:31.230 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:31.230 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:31.230 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:31.230 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9374640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:31.230 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9374640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:31.230 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9374640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:31.230 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9b75640 1 --2- 10.20.193.77:0/2619505824 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f57d40a07d0 0x7f57d4096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:31.230 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9b75640 10 monclient(hunting): get_auth_request con 0x7f57d40a07d0 auth_method 0 2026-02-17T12:07:31.230 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9b75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:31.231 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9b75640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:31.231 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57d9b75640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:31.231 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 10 monclient(hunting): handle_auth_done global_id 4527 payload 824 2026-02-17T12:07:31.231 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 1 -- 10.20.193.77:0/2619505824 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f57d40a2750 msgr2=0x7f57d4073c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:31.231 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 1 --2- 10.20.193.77:0/2619505824 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f57d40a2750 0x7f57d4073c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:31.231 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 1 -- 10.20.193.77:0/2619505824 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f57d40a07d0 msgr2=0x7f57d4096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:31.231 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 1 --2- 10.20.193.77:0/2619505824 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f57d40a07d0 0x7f57d4096f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:31.231 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 10 monclient: _finish_hunting 0 2026-02-17T12:07:31.231 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 1 monclient: found mon.noname-a 2026-02-17T12:07:31.231 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:31.231 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:31.231 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.207+0000 7f57da376640 1 -- 10.20.193.77:0/2619505824 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d40a2520 con 0x7f57d413a990 2026-02-17T12:07:31.232 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57da376640 1 -- 10.20.193.77:0/2619505824 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f57d413a990 msgr2=0x7f57d4072040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:31.232 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57da376640 1 --2- 10.20.193.77:0/2619505824 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f57d413a990 0x7f57d4072040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009fa0 tx=0x7f57d000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:31.232 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 1 -- 10.20.193.77:0/2619505824 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d001a070 con 0x7f57d413a990 2026-02-17T12:07:31.232 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:31.232 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:31.232 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 10 monclient: dump: 2026-02-17T12:07:31.232 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:31.232 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:31.232 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:31.232 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:31.232 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:31.232 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:31.232 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:31.233 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:31.233 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:31.233 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:31.233 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 10 monclient: _finish_auth 0 2026-02-17T12:07:31.233 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 10 monclient: _check_auth_tickets 2026-02-17T12:07:31.233 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:31.233 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 1 -- 10.20.193.77:0/2619505824 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d0003cc0 con 0x7f57d413a990 2026-02-17T12:07:31.233 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:31.233 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 1 -- 10.20.193.77:0/2619505824 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d00127a0 con 0x7f57d413a990 2026-02-17T12:07:31.233 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:31.233 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:31.233 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 10 monclient: dump: 2026-02-17T12:07:31.234 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:31.234 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:31.234 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:31.234 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:31.234 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:31.234 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:31.234 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:31.234 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:31.234 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:31.234 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:31.234 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c3fff640 4 set_mon_vals no callback set 2026-02-17T12:07:31.234 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57dbe00640 5 monclient: authenticate success, global_id 4527 2026-02-17T12:07:31.234 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57dbe00640 10 monclient: _renew_subs 2026-02-17T12:07:31.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57dbe00640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:31.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57dbe00640 1 -- 10.20.193.77:0/2619505824 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d40965b0 con 0x7f57d413a990 2026-02-17T12:07:31.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57dbe00640 10 monclient: _renew_subs 2026-02-17T12:07:31.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57dbe00640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:31.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57dbe00640 1 -- 10.20.193.77:0/2619505824 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d408e340 con 0x7f57d413a990 2026-02-17T12:07:31.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57dbe00640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:31.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57dbe00640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:31.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57dbe00640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:31.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57dbe00640 1 -- 10.20.193.77:0/2619505824 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57d40a2210 con 0x7f57d413a990 2026-02-17T12:07:31.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57da376640 1 --2- 10.20.193.77:0/2619505824 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f57d413a990 0x7f57d4072040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009fa0 tx=0x7f57d000d560 comp rx=0 tx=0).queue_received will delay after 1.77133e+09 on 0x7f57d004e030 osd_map(29..29 src has 1..29) 2026-02-17T12:07:31.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 1 -- 10.20.193.77:0/2619505824 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f57d00129c0 con 0x7f57d413a990 2026-02-17T12:07:31.235 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 1 --2- 10.20.193.77:0/2619505824 >> v2:10.20.193.119:6800/4127986552 conn(0x7f57a403a170 0x7f57a403c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:31.236 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57d9b75640 1 --2- 10.20.193.77:0/2619505824 >> v2:10.20.193.119:6800/4127986552 conn(0x7f57a403a170 0x7f57a403c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:31.236 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57d9b75640 10 monclient: get_auth_request con 0x7f57a403a170 auth_method 0 2026-02-17T12:07:31.236 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.211+0000 7f57c27fc640 1 -- 10.20.193.77:0/2619505824 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f57d004e030 con 0x7f57d413a990 2026-02-17T12:07:31.236 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:31.215+0000 7f57d9b75640 1 --2- 10.20.193.77:0/2619505824 >> v2:10.20.193.119:6800/4127986552 conn(0x7f57a403a170 0x7f57a403c630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f57c4004000 tx=0x7f57c40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:32.046 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.039+0000 7f57c27fc640 1 -- 10.20.193.77:0/2619505824 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f57d40965b0 con 0x7f57d413a990 2026-02-17T12:07:32.046 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.039+0000 7f57c27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:32.046 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.039+0000 7f57c27fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:32.121 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.115+0000 7f57dbe00640 1 -- 10.20.193.77:0/2619505824 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f57d406d670 con 0x7f57a403a170 2026-02-17T12:07:32.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.115+0000 7f57c27fc640 1 -- 10.20.193.77:0/2619505824 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f57d406d670 con 0x7f57a403a170 2026-02-17T12:07:32.122 INFO:teuthology.orchestra.run.trial077.stderr:instructed osd(s) 5 to deep-scrub 2026-02-17T12:07:32.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.119+0000 7f57dbe00640 1 -- 10.20.193.77:0/2619505824 >> v2:10.20.193.119:6800/4127986552 conn(0x7f57a403a170 msgr2=0x7f57a403c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:32.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.119+0000 7f57dbe00640 1 --2- 10.20.193.77:0/2619505824 >> v2:10.20.193.119:6800/4127986552 conn(0x7f57a403a170 0x7f57a403c630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f57c4004000 tx=0x7f57c40a7000 comp rx=0 tx=0).stop 2026-02-17T12:07:32.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.119+0000 7f57dbe00640 10 monclient: shutdown 2026-02-17T12:07:32.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.119+0000 7f57dbe00640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:32.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.119+0000 7f57dbe00640 1 -- 10.20.193.77:0/2619505824 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f57d413a990 msgr2=0x7f57d4072040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:32.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.119+0000 7f57dbe00640 1 --2- 10.20.193.77:0/2619505824 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f57d413a990 0x7f57d4072040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009fa0 tx=0x7f57d000d560 comp rx=0 tx=0).stop 2026-02-17T12:07:32.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.119+0000 7f57dbe00640 1 -- 10.20.193.77:0/2619505824 shutdown_connections 2026-02-17T12:07:32.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.119+0000 7f57dbe00640 1 --2- 10.20.193.77:0/2619505824 >> v2:10.20.193.119:6800/4127986552 conn(0x7f57a403a170 0x7f57a403c630 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.119+0000 7f57dbe00640 1 --2- 10.20.193.77:0/2619505824 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f57d413a990 0x7f57d4072040 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.119+0000 7f57dbe00640 1 --2- 10.20.193.77:0/2619505824 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f57d40a2750 0x7f57d4073c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.119+0000 7f57dbe00640 1 --2- 10.20.193.77:0/2619505824 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f57d40a07d0 0x7f57d4096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.122 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.119+0000 7f57dbe00640 1 -- 10.20.193.77:0/2619505824 >> 10.20.193.77:0/2619505824 conn(0x7f57d40a73c0 msgr2=0x7f57d40a5590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:32.123 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.119+0000 7f57dbe00640 1 -- 10.20.193.77:0/2619505824 shutdown_connections 2026-02-17T12:07:32.123 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.119+0000 7f57dbe00640 1 -- 10.20.193.77:0/2619505824 wait complete. 2026-02-17T12:07:32.132 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:07:32.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 10 monclient: get_monmap_and_config 2026-02-17T12:07:32.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 10 monclient: build_initial_monmap 2026-02-17T12:07:32.201 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 10 monclient: monmap: 2026-02-17T12:07:32.201 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:32.201 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:32.201 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:32.199907+0000 2026-02-17T12:07:32.201 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:32.199907+0000 2026-02-17T12:07:32.201 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:32.201 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:32.201 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:32.201 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:32.202 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:32.202 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:32.202 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:32.202 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:32.204 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 1 Processor -- start 2026-02-17T12:07:32.204 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 1 -- start start 2026-02-17T12:07:32.204 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 10 monclient: init 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f2e1809c420 0x7f2e180a2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 10 monclient(hunting): picked mon.noname-a con 0x7f2e1809c420 addr v2:10.20.193.77:3300/0 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f2e180a2750 0x7f2e180a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 10 monclient(hunting): picked mon.noname-c con 0x7f2e180a2750 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2e18139980 addr v1:10.20.193.77:6789/0 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 1 -- --> v1:10.20.193.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1809ffa0 con 0x7f2e18139980 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2e1809f3e0 con 0x7f2e1809c420 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f2e1809acc0 con 0x7f2e180a2750 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e1ce00640 10 monclient(hunting): authenticate will time out at 703.875587s 2026-02-17T12:07:32.205 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f2e1809c420 0x7f2e180a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16d76640 1 --1- >> v1:10.20.193.77:6789/0 conn(0x7f2e18139980 0x7f2e1813bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.77:6789/0 says I am v1:10.20.193.77:51682/0 (socket says 10.20.193.77:51682) 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16d76640 1 -- 10.20.193.77:0/209500639 learned_addr learned my addr 10.20.193.77:0/209500639 (peer_addr_for_me v1:10.20.193.77:0/0) 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 10 monclient(hunting): get_auth_request con 0x7f2e1809c420 auth_method 0 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e15d74640 1 --2- 10.20.193.77:0/209500639 >> v2:10.20.193.119:3300/0 conn(0x7f2e180a2750 0x7f2e180a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e15d74640 10 monclient(hunting): get_auth_request con 0x7f2e180a2750 auth_method 0 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e15d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e15d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e15d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 10 monclient(hunting): handle_auth_done global_id 4530 payload 274 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 1 -- 10.20.193.77:0/209500639 >> v2:10.20.193.119:3300/0 conn(0x7f2e180a2750 msgr2=0x7f2e180a2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 1 --2- 10.20.193.77:0/209500639 >> v2:10.20.193.119:3300/0 conn(0x7f2e180a2750 0x7f2e180a2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 1 -- 10.20.193.77:0/209500639 >> v1:10.20.193.77:6789/0 conn(0x7f2e18139980 legacy=0x7f2e1813bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 10 monclient: _finish_hunting 0 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 1 monclient: found mon.noname-a 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:32.206 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.195+0000 7f2e16575640 1 -- 10.20.193.77:0/209500639 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1809f860 con 0x7f2e1809c420 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e16575640 1 -- 10.20.193.77:0/209500639 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e1809c420 msgr2=0x7f2e180a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e16575640 1 --2- 10.20.193.77:0/209500639 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e1809c420 0x7f2e180a2210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2e1806ecb0 tx=0x7f2e0c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ca4a58508832de server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e15573640 1 -- 10.20.193.77:0/209500639 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0b0070 con 0x7f2e1809c420 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e15573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e15573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e15573640 10 monclient: dump: 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e15573640 10 monclient: _finish_auth 0 2026-02-17T12:07:32.208 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e15573640 10 monclient: _check_auth_tickets 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e15573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e15573640 1 -- 10.20.193.77:0/209500639 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c0ab600 con 0x7f2e1809c420 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e1ce00640 5 monclient: authenticate success, global_id 4530 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e1ce00640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e15573640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e15573640 1 -- 10.20.193.77:0/209500639 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0ab9d0 con 0x7f2e1809c420 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e15573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e15573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e15573640 10 monclient: dump: 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e1ce00640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e1ce00640 4 set_mon_vals no callback set 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e1ce00640 10 monclient: shutdown 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e1ce00640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e1ce00640 1 -- 10.20.193.77:0/209500639 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e1809c420 msgr2=0x7f2e180a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e1ce00640 1 --2- 10.20.193.77:0/209500639 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e1809c420 0x7f2e180a2210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2e1806ecb0 tx=0x7f2e0c01c4f0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e1ce00640 1 -- 10.20.193.77:0/209500639 shutdown_connections 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e1ce00640 1 --2- 10.20.193.77:0/209500639 >> v2:10.20.193.119:3300/0 conn(0x7f2e180a2750 0x7f2e180a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e1ce00640 1 --2- 10.20.193.77:0/209500639 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e1809c420 0x7f2e180a2210 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e1ce00640 1 -- 10.20.193.77:0/209500639 >> 10.20.193.77:0/209500639 conn(0x7f2e180a73c0 msgr2=0x7f2e180a3300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e1ce00640 1 -- 10.20.193.77:0/209500639 shutdown_connections 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.199+0000 7f2e1ce00640 1 -- 10.20.193.77:0/209500639 wait complete. 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient: build_initial_monmap 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient: monmap: 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:32.209 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 1 Processor -- start 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 1 -- start start 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient: init 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e1809c420 0x7f2e18139310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient(hunting): picked mon.noname-a con 0x7f2e1809c420 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f2e180a2750 0x7f2e18139d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient(hunting): picked mon.noname-c con 0x7f2e180a2750 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e18139980 0x7f2e1813a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient(hunting): picked mon.noname-b con 0x7f2e18139980 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2e180a0340 con 0x7f2e1809c420 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2e180a01c0 con 0x7f2e18139980 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1813fcb0 con 0x7f2e180a2750 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient(hunting): authenticate will time out at 703.880961s 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e1809c420 0x7f2e18139310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e1809c420 0x7f2e18139310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:54880/0 (socket says 10.20.193.77:54880) 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 1 -- 10.20.193.77:0/115177574 learned_addr learned my addr 10.20.193.77:0/115177574 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 10 monclient(hunting): get_auth_request con 0x7f2e1809c420 auth_method 0 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e15d74640 1 --2- 10.20.193.77:0/115177574 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f2e180a2750 0x7f2e18139d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e15d74640 10 monclient(hunting): get_auth_request con 0x7f2e180a2750 auth_method 0 2026-02-17T12:07:32.210 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e15d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e15d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e15d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e15d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e15d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16d76640 1 --2- 10.20.193.77:0/115177574 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e18139980 0x7f2e1813a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e15d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16d76640 10 monclient(hunting): get_auth_request con 0x7f2e18139980 auth_method 0 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 10 monclient(hunting): handle_auth_done global_id 4533 payload 824 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 1 -- 10.20.193.77:0/115177574 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f2e180a2750 msgr2=0x7f2e18139d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 1 --2- 10.20.193.77:0/115177574 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f2e180a2750 0x7f2e18139d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 1 -- 10.20.193.77:0/115177574 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e18139980 msgr2=0x7f2e1813a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 1 --2- 10.20.193.77:0/115177574 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e18139980 0x7f2e1813a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 10 monclient: _finish_hunting 0 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 1 monclient: found mon.noname-a 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:32.211 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 1 -- 10.20.193.77:0/115177574 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e180954f0 con 0x7f2e1809c420 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 1 -- 10.20.193.77:0/115177574 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e1809c420 msgr2=0x7f2e18139310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e16575640 1 --2- 10.20.193.77:0/115177574 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e1809c420 0x7f2e18139310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0ae040 tx=0x7f2e0c019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2dfeffd640 1 -- 10.20.193.77:0/115177574 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0b0040 con 0x7f2e1809c420 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2dfeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2dfeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2dfeffd640 10 monclient: dump: 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2dfeffd640 10 monclient: _finish_auth 0 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2dfeffd640 10 monclient: _check_auth_tickets 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2dfeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2dfeffd640 1 -- 10.20.193.77:0/115177574 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c0b9070 con 0x7f2e1809c420 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 5 monclient: authenticate success, global_id 4533 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient: _renew_subs 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 1 -- 10.20.193.77:0/115177574 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e180957d0 con 0x7f2e1809c420 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2dfeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2dfeffd640 1 -- 10.20.193.77:0/115177574 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0aa9f0 con 0x7f2e1809c420 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2dfeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2dfeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2dfeffd640 10 monclient: dump: 2026-02-17T12:07:32.212 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e14d72640 4 set_mon_vals no callback set 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient: _renew_subs 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.203+0000 7f2e1ce00640 1 -- 10.20.193.77:0/115177574 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e1813b7a0 con 0x7f2e1809c420 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.207+0000 7f2e1ce00640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.207+0000 7f2dfeffd640 1 -- 10.20.193.77:0/115177574 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f2e0c0b3070 con 0x7f2e1809c420 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.207+0000 7f2e1ce00640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.207+0000 7f2e1ce00640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.207+0000 7f2e1ce00640 1 -- 10.20.193.77:0/115177574 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e180a2210 con 0x7f2e1809c420 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.207+0000 7f2dfeffd640 1 --2- 10.20.193.77:0/115177574 >> v2:10.20.193.119:6800/4127986552 conn(0x7f2de403a170 0x7f2de403c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.207+0000 7f2dfeffd640 1 -- 10.20.193.77:0/115177574 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f2e0c0e7320 con 0x7f2e1809c420 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.207+0000 7f2e15d74640 1 --2- 10.20.193.77:0/115177574 >> v2:10.20.193.119:6800/4127986552 conn(0x7f2de403a170 0x7f2de403c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.207+0000 7f2e15d74640 10 monclient: get_auth_request con 0x7f2de403a170 auth_method 0 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.207+0000 7f2dfeffd640 1 -- 10.20.193.77:0/115177574 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f2e0c016170 con 0x7f2e1809c420 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.207+0000 7f2dfeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.207+0000 7f2dfeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:32.213 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.207+0000 7f2e15d74640 1 --2- 10.20.193.77:0/115177574 >> v2:10.20.193.119:6800/4127986552 conn(0x7f2de403a170 0x7f2de403c630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e1809c1c0 tx=0x7f2e00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:32.288 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 1 -- 10.20.193.77:0/115177574 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e1806d670 con 0x7f2de403a170 2026-02-17T12:07:32.289 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2dfeffd640 1 -- 10.20.193.77:0/115177574 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33938 (secure 0 0 0) 0x7f2e1806d670 con 0x7f2de403a170 2026-02-17T12:07:32.290 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:07:32.291 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T12:07:32.291 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 1 -- 10.20.193.77:0/115177574 >> v2:10.20.193.119:6800/4127986552 conn(0x7f2de403a170 msgr2=0x7f2de403c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:32.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 1 --2- 10.20.193.77:0/115177574 >> v2:10.20.193.119:6800/4127986552 conn(0x7f2de403a170 0x7f2de403c630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e1809c1c0 tx=0x7f2e00008040 comp rx=0 tx=0).stop 2026-02-17T12:07:32.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 10 monclient: shutdown 2026-02-17T12:07:32.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:32.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 1 -- 10.20.193.77:0/115177574 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e1809c420 msgr2=0x7f2e18139310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:32.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 1 --2- 10.20.193.77:0/115177574 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e1809c420 0x7f2e18139310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0ae040 tx=0x7f2e0c019290 comp rx=0 tx=0).stop 2026-02-17T12:07:32.292 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 1 -- 10.20.193.77:0/115177574 shutdown_connections 2026-02-17T12:07:32.293 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 1 --2- 10.20.193.77:0/115177574 >> v2:10.20.193.119:6800/4127986552 conn(0x7f2de403a170 0x7f2de403c630 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.293 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 1 --2- 10.20.193.77:0/115177574 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f2e18139980 0x7f2e1813a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.293 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 1 --2- 10.20.193.77:0/115177574 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f2e180a2750 0x7f2e18139d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.293 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 1 --2- 10.20.193.77:0/115177574 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f2e1809c420 0x7f2e18139310 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:32.293 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 1 -- 10.20.193.77:0/115177574 >> 10.20.193.77:0/115177574 conn(0x7f2e180a73c0 msgr2=0x7f2e1809b170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:32.293 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 1 -- 10.20.193.77:0/115177574 shutdown_connections 2026-02-17T12:07:32.293 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:32.283+0000 7f2e1ce00640 1 -- 10.20.193.77:0/115177574 wait complete. 2026-02-17T12:07:32.300 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2026-02-17T12:07:32.281087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":184196,"kb_used_data":1600,"kb_used_omap":9,"kb_used_meta":182454,"kb_avail":566046844,"statfs":{"total":579820584960,"available":579631968256,"internally_reserved":0,"allocated":1638400,"data_stored":1609924,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":186833575},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000997"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567297+0000","last_change":"2026-02-17T12:05:14.474034+0000","last_active":"2026-02-17T12:05:50.567297+0000","last_peered":"2026-02-17T12:05:50.567297+0000","last_clean":"2026-02-17T12:05:50.567297+0000","last_became_active":"2026-02-17T12:05:12.276658+0000","last_became_peered":"2026-02-17T12:05:12.276658+0000","last_unstale":"2026-02-17T12:05:50.567297+0000","last_undegraded":"2026-02-17T12:05:50.567297+0000","last_fullsized":"2026-02-17T12:05:50.567297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:42:47.843930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048223100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:07:30.229649+0000","last_change":"2026-02-17T12:07:30.229666+0000","last_active":"2026-02-17T12:07:30.229649+0000","last_peered":"2026-02-17T12:07:30.229649+0000","last_clean":"2026-02-17T12:07:30.229649+0000","last_became_active":"2026-02-17T12:05:12.278326+0000","last_became_peered":"2026-02-17T12:05:12.278326+0000","last_unstale":"2026-02-17T12:07:30.229649+0000","last_undegraded":"2026-02-17T12:07:30.229649+0000","last_fullsized":"2026-02-17T12:07:30.229649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:07:30.229591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:07:30.229591+0000","last_clean_scrub_stamp":"2026-02-17T12:07:30.229591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:38:49.580296+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.00031809399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567244+0000","last_change":"2026-02-17T12:05:14.473914+0000","last_active":"2026-02-17T12:05:50.567244+0000","last_peered":"2026-02-17T12:05:50.567244+0000","last_clean":"2026-02-17T12:05:50.567244+0000","last_became_active":"2026-02-17T12:05:12.528026+0000","last_became_peered":"2026-02-17T12:05:12.528026+0000","last_unstale":"2026-02-17T12:05:50.567244+0000","last_undegraded":"2026-02-17T12:05:50.567244+0000","last_fullsized":"2026-02-17T12:05:50.567244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:38:50.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039251500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:07:20.296214+0000","last_change":"2026-02-17T12:05:14.478884+0000","last_active":"2026-02-17T12:07:20.296214+0000","last_peered":"2026-02-17T12:07:20.296214+0000","last_clean":"2026-02-17T12:07:20.296214+0000","last_became_active":"2026-02-17T12:05:12.529966+0000","last_became_peered":"2026-02-17T12:05:12.529966+0000","last_unstale":"2026-02-17T12:07:20.296214+0000","last_undegraded":"2026-02-17T12:07:20.296214+0000","last_fullsized":"2026-02-17T12:07:20.296214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033970499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.553272+0000","last_change":"2026-02-17T12:05:14.475335+0000","last_active":"2026-02-17T12:05:51.553272+0000","last_peered":"2026-02-17T12:05:51.553272+0000","last_clean":"2026-02-17T12:05:51.553272+0000","last_became_active":"2026-02-17T12:05:12.276436+0000","last_became_peered":"2026-02-17T12:05:12.276436+0000","last_unstale":"2026-02-17T12:05:51.553272+0000","last_undegraded":"2026-02-17T12:05:51.553272+0000","last_fullsized":"2026-02-17T12:05:51.553272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:54:19.820473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054557800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.554560+0000","last_change":"2026-02-17T12:05:14.742903+0000","last_active":"2026-02-17T12:05:51.554560+0000","last_peered":"2026-02-17T12:05:51.554560+0000","last_clean":"2026-02-17T12:05:51.554560+0000","last_became_active":"2026-02-17T12:05:12.278426+0000","last_became_peered":"2026-02-17T12:05:12.278426+0000","last_unstale":"2026-02-17T12:05:51.554560+0000","last_undegraded":"2026-02-17T12:05:51.554560+0000","last_fullsized":"2026-02-17T12:05:51.554560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:36:27.118344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032063000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567254+0000","last_change":"2026-02-17T12:05:14.473834+0000","last_active":"2026-02-17T12:05:50.567254+0000","last_peered":"2026-02-17T12:05:50.567254+0000","last_clean":"2026-02-17T12:05:50.567254+0000","last_became_active":"2026-02-17T12:05:12.276579+0000","last_became_peered":"2026-02-17T12:05:12.276579+0000","last_unstale":"2026-02-17T12:05:50.567254+0000","last_undegraded":"2026-02-17T12:05:50.567254+0000","last_fullsized":"2026-02-17T12:05:50.567254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:36:50.953203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311976,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:51.553311+0000","last_change":"2026-02-17T12:05:14.475054+0000","last_active":"2026-02-17T12:05:51.553311+0000","last_peered":"2026-02-17T12:05:51.553311+0000","last_clean":"2026-02-17T12:05:51.553311+0000","last_became_active":"2026-02-17T12:05:12.276141+0000","last_became_peered":"2026-02-17T12:05:12.276141+0000","last_unstale":"2026-02-17T12:05:51.553311+0000","last_undegraded":"2026-02-17T12:05:51.553311+0000","last_fullsized":"2026-02-17T12:05:51.553311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:11.266842+0000","last_clean_scrub_stamp":"2026-02-17T12:05:11.266842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:51:25.694043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025524199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'112","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:05:50.567297+0000","last_change":"2026-02-17T12:05:08.039772+0000","last_active":"2026-02-17T12:05:50.567297+0000","last_peered":"2026-02-17T12:05:50.567297+0000","last_clean":"2026-02-17T12:05:50.567297+0000","last_became_active":"2026-02-17T12:05:08.039610+0000","last_became_peered":"2026-02-17T12:05:08.039610+0000","last_unstale":"2026-02-17T12:05:50.567297+0000","last_undegraded":"2026-02-17T12:05:50.567297+0000","last_fullsized":"2026-02-17T12:05:50.567297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:05:06.954552+0000","last_clean_scrub_stamp":"2026-02-17T12:05:06.954552+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:26:36.107316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":258048,"data_stored":92024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607583,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":253952,"data_stored":92005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607583,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":307200,"data_stored":620933,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607583,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":253952,"data_stored":92005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607583,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":258048,"data_stored":92024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640288,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":307200,"data_stored":620933,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:07:32.305 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-17T12:05:11.266842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=5, tm_sec=11, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=7, tm_sec=28, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:07:32.306 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-17T12:05:11.266842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=5, tm_sec=11, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=7, tm_sec=28, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:07:32.306 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-17T12:05:11.266842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=5, tm_sec=11, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=7, tm_sec=28, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:07:32.306 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-17T12:05:11.266842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=5, tm_sec=11, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=7, tm_sec=28, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:07:32.307 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-17T12:05:11.266842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=5, tm_sec=11, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=7, tm_sec=28, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:07:32.307 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-17T12:05:11.266842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=5, tm_sec=11, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=7, tm_sec=28, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:07:32.307 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-17T12:05:11.266842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=5, tm_sec=11, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=7, tm_sec=28, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:07:32.307 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T12:05:06.954552+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=5, tm_sec=6, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=7, tm_sec=28, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:07:32.307 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T12:07:52.308 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:07:52.378 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.370+0000 7fbe11efc640 10 monclient: get_monmap_and_config 2026-02-17T12:07:52.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.370+0000 7fbe11efc640 10 monclient: build_initial_monmap 2026-02-17T12:07:52.379 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.370+0000 7fbe11efc640 10 monclient: monmap: 2026-02-17T12:07:52.379 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:52.379 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:52.379 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:52.376948+0000 2026-02-17T12:07:52.379 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:52.376948+0000 2026-02-17T12:07:52.379 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:52.379 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:52.379 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:52.379 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:52.380 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:52.380 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:52.380 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:52.380 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:52.380 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 1 Processor -- start 2026-02-17T12:07:52.380 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 1 -- start start 2026-02-17T12:07:52.380 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 10 monclient: init 2026-02-17T12:07:52.382 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:52.383 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 10 monclient: _add_conns ranks=[2,1,3,0,4] 2026-02-17T12:07:52.383 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbe0c09be20 0x7fbe0c134e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:52.383 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 10 monclient(hunting): picked mon.noname-b con 0x7fbe0c09be20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:52.383 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbe0c0a4c20 addr v1:10.20.193.119:6789/0 2026-02-17T12:07:52.383 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fbe0c0a5040 0x7fbe0c138800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:52.383 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 10 monclient(hunting): picked mon.noname-a con 0x7fbe0c0a5040 addr v2:10.20.193.77:3300/0 2026-02-17T12:07:52.383 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0c09cdf0 con 0x7fbe0c0a4c20 2026-02-17T12:07:52.383 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:52.383 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbe0c09c200 con 0x7fbe0c0a5040 2026-02-17T12:07:52.383 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:52.384 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0c09d0d0 con 0x7fbe0c09be20 2026-02-17T12:07:52.384 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:52.384 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe11efc640 10 monclient(hunting): authenticate will time out at 724.052532s 2026-02-17T12:07:52.384 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0b7fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbe0c09be20 0x7fbe0c134e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:52.384 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7fbe0c0a5040 0x7fbe0c138800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:52.384 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0b7fe640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbe0c09be20 0x7fbe0c134e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:38948/0 (socket says 10.20.193.77:38948) 2026-02-17T12:07:52.384 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0b7fe640 1 -- 10.20.193.77:0/4054312929 learned_addr learned my addr 10.20.193.77:0/4054312929 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:52.384 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0b7fe640 10 monclient(hunting): get_auth_request con 0x7fbe0c09be20 auth_method 0 2026-02-17T12:07:52.384 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:52.384 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:52.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:52.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request con 0x7fbe0c0a5040 auth_method 0 2026-02-17T12:07:52.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:52.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:52.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:52.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:52.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:52.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:52.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:52.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:52.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:52.385 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_done global_id 4536 payload 274 2026-02-17T12:07:52.386 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 1 -- 10.20.193.77:0/4054312929 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbe0c09be20 msgr2=0x7fbe0c134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:52.386 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 1 --2- 10.20.193.77:0/4054312929 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbe0c09be20 0x7fbe0c134e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:52.386 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 1 -- 10.20.193.77:0/4054312929 >> v1:10.20.193.119:6789/0 conn(0x7fbe0c0a4c20 legacy=0x7fbe0c1380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:52.386 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 10 monclient: _finish_hunting 0 2026-02-17T12:07:52.386 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 1 monclient: found mon.noname-a 2026-02-17T12:07:52.386 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:52.386 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:52.386 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.374+0000 7fbe0bfff640 1 -- 10.20.193.77:0/4054312929 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c09d3b0 con 0x7fbe0c0a5040 2026-02-17T12:07:52.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0bfff640 1 -- 10.20.193.77:0/4054312929 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbe0c0a5040 msgr2=0x7fbe0c138800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:52.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0bfff640 1 --2- 10.20.193.77:0/4054312929 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbe0c0a5040 0x7fbe0c138800 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009d90 tx=0x7fbe0001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b0537553b00a13 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:52.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0a7fc640 1 -- 10.20.193.77:0/4054312929 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe000b2070 con 0x7fbe0c0a5040 2026-02-17T12:07:52.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:52.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:52.393 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0a7fc640 10 monclient: dump: 2026-02-17T12:07:52.394 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:52.394 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:52.394 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.394 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.394 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:52.394 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:52.394 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:52.394 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:52.394 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:52.394 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:52.394 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0a7fc640 10 monclient: _finish_auth 0 2026-02-17T12:07:52.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0a7fc640 10 monclient: _check_auth_tickets 2026-02-17T12:07:52.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:52.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0a7fc640 1 -- 10.20.193.77:0/4054312929 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe000a57a0 con 0x7fbe0c0a5040 2026-02-17T12:07:52.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:52.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0a7fc640 1 -- 10.20.193.77:0/4054312929 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe000a5b70 con 0x7fbe0c0a5040 2026-02-17T12:07:52.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 5 monclient: authenticate success, global_id 4536 2026-02-17T12:07:52.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:52.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 4 set_mon_vals no callback set 2026-02-17T12:07:52.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:52.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:52.395 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0a7fc640 10 monclient: dump: 2026-02-17T12:07:52.395 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:52.396 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:52.396 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.396 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.396 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:52.396 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:52.396 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:52.396 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:52.396 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:52.396 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:52.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient: shutdown 2026-02-17T12:07:52.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:52.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 -- 10.20.193.77:0/4054312929 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbe0c0a5040 msgr2=0x7fbe0c138800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:52.396 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 --2- 10.20.193.77:0/4054312929 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbe0c0a5040 0x7fbe0c138800 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009d90 tx=0x7fbe0001c850 comp rx=0 tx=0).stop 2026-02-17T12:07:52.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 -- 10.20.193.77:0/4054312929 shutdown_connections 2026-02-17T12:07:52.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 --2- 10.20.193.77:0/4054312929 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbe0c0a5040 0x7fbe0c138800 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:52.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 --2- 10.20.193.77:0/4054312929 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbe0c09be20 0x7fbe0c134e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:52.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 -- 10.20.193.77:0/4054312929 >> 10.20.193.77:0/4054312929 conn(0x7fbe0c074ba0 msgr2=0x7fbe0c0aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:52.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 -- 10.20.193.77:0/4054312929 shutdown_connections 2026-02-17T12:07:52.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 -- 10.20.193.77:0/4054312929 wait complete. 2026-02-17T12:07:52.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient: build_initial_monmap 2026-02-17T12:07:52.397 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient: monmap: 2026-02-17T12:07:52.397 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:52.397 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:52.397 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:52.397 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:52.397 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:52.398 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:52.398 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:52.398 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:52.398 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:52.398 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:52.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 Processor -- start 2026-02-17T12:07:52.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 -- start start 2026-02-17T12:07:52.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient: init 2026-02-17T12:07:52.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:52.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T12:07:52.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbe0c09be20 0x7fbe0c131a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:52.398 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient(hunting): picked mon.noname-a con 0x7fbe0c09be20 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:52.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbe0c0a4c20 0x7fbe0c0a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:52.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient(hunting): picked mon.noname-c con 0x7fbe0c0a4c20 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:52.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbe0c0a5040 0x7fbe0c0a2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:52.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient(hunting): picked mon.noname-b con 0x7fbe0c0a5040 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:52.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:52.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c138f50 con 0x7fbe0c09be20 2026-02-17T12:07:52.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:52.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c142ec0 con 0x7fbe0c0a5040 2026-02-17T12:07:52.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:52.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0c143040 con 0x7fbe0c0a4c20 2026-02-17T12:07:52.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:52.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe11efc640 10 monclient(hunting): authenticate will time out at 724.058592s 2026-02-17T12:07:52.399 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbe0c0a4c20 0x7fbe0c0a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:52.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0b7fe640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbe0c09be20 0x7fbe0c131a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:52.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbe0c0a4c20 0x7fbe0c0a2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3301/0 says I am v2:10.20.193.77:38964/0 (socket says 10.20.193.77:38964) 2026-02-17T12:07:52.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 1 -- 10.20.193.77:0/1325212782 learned_addr learned my addr 10.20.193.77:0/1325212782 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:52.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 10 monclient(hunting): get_auth_request con 0x7fbe0c0a4c20 auth_method 0 2026-02-17T12:07:52.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:52.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:52.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:52.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0b7fe640 10 monclient(hunting): get_auth_request con 0x7fbe0c09be20 auth_method 0 2026-02-17T12:07:52.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:52.400 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:52.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:52.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:52.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:52.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:52.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:52.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:52.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:52.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 10 monclient(hunting): handle_auth_done global_id 4526 payload 824 2026-02-17T12:07:52.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 1 -- 10.20.193.77:0/1325212782 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbe0c0a5040 msgr2=0x7fbe0c0a2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:52.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 1 --2- 10.20.193.77:0/1325212782 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbe0c0a5040 0x7fbe0c0a2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:52.401 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 1 -- 10.20.193.77:0/1325212782 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbe0c09be20 msgr2=0x7fbe0c131a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:52.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 1 --2- 10.20.193.77:0/1325212782 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbe0c09be20 0x7fbe0c131a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:52.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 10 monclient: _finish_hunting 0 2026-02-17T12:07:52.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 1 monclient: found mon.noname-c 2026-02-17T12:07:52.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:52.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.77:3301/0 2026-02-17T12:07:52.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.378+0000 7fbe0affd640 1 -- 10.20.193.77:0/1325212782 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c13af60 con 0x7fbe0c0a4c20 2026-02-17T12:07:52.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe0affd640 1 -- 10.20.193.77:0/1325212782 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbe0c0a4c20 msgr2=0x7fbe0c0a2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:52.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe0affd640 1 --2- 10.20.193.77:0/1325212782 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbe0c0a4c20 0x7fbe0c0a2a10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c550 tx=0x7fbdfc00ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:52.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 1 -- 10.20.193.77:0/1325212782 <== mon.2 v2:10.20.193.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc016020 con 0x7fbe0c0a4c20 2026-02-17T12:07:52.402 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:52.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T12:07:52.403 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 10 monclient: dump: 2026-02-17T12:07:52.403 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:52.403 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:52.403 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.403 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.403 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:52.403 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:52.403 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:52.403 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:52.403 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:52.404 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:52.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 10 monclient: _finish_auth 0 2026-02-17T12:07:52.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 10 monclient: _check_auth_tickets 2026-02-17T12:07:52.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:52.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 1 -- 10.20.193.77:0/1325212782 <== mon.2 v2:10.20.193.77:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdfc012a60 con 0x7fbe0c0a4c20 2026-02-17T12:07:52.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:52.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 1 -- 10.20.193.77:0/1325212782 <== mon.2 v2:10.20.193.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc012e50 con 0x7fbe0c0a4c20 2026-02-17T12:07:52.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:52.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T12:07:52.404 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 10 monclient: dump: 2026-02-17T12:07:52.404 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:52.405 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:52.405 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.405 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.405 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:52.405 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:52.405 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:52.405 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:52.405 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:52.405 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:52.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe09ffb640 4 set_mon_vals no callback set 2026-02-17T12:07:52.405 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe11efc640 5 monclient: authenticate success, global_id 4526 2026-02-17T12:07:52.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe11efc640 10 monclient: _renew_subs 2026-02-17T12:07:52.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe11efc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:52.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe11efc640 1 -- 10.20.193.77:0/1325212782 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0c0aaba0 con 0x7fbe0c0a4c20 2026-02-17T12:07:52.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe11efc640 10 monclient: _renew_subs 2026-02-17T12:07:52.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe11efc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:52.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe11efc640 1 -- 10.20.193.77:0/1325212782 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0c13ac80 con 0x7fbe0c0a4c20 2026-02-17T12:07:52.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe11efc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:52.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe11efc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:52.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe11efc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.77:3301/0 2026-02-17T12:07:52.406 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe11efc640 1 -- 10.20.193.77:0/1325212782 --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe0c134e20 con 0x7fbe0c0a4c20 2026-02-17T12:07:52.407 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 1 -- 10.20.193.77:0/1325212782 <== mon.2 v2:10.20.193.77:3301/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7fbdfc01b400 con 0x7fbe0c0a4c20 2026-02-17T12:07:52.407 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 1 --2- 10.20.193.77:0/1325212782 >> v2:10.20.193.119:6800/4127986552 conn(0x7fbddc03a310 0x7fbddc03c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:52.407 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbde7fff640 1 -- 10.20.193.77:0/1325212782 <== mon.2 v2:10.20.193.77:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7fbdfc04dcd0 con 0x7fbe0c0a4c20 2026-02-17T12:07:52.407 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe0b7fe640 1 --2- 10.20.193.77:0/1325212782 >> v2:10.20.193.119:6800/4127986552 conn(0x7fbddc03a310 0x7fbddc03c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:52.407 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.382+0000 7fbe0b7fe640 10 monclient: get_auth_request con 0x7fbddc03a310 auth_method 0 2026-02-17T12:07:52.407 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.386+0000 7fbde7fff640 1 -- 10.20.193.77:0/1325212782 <== mon.2 v2:10.20.193.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7fbdfc020020 con 0x7fbe0c0a4c20 2026-02-17T12:07:52.407 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.386+0000 7fbde7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:52.407 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.386+0000 7fbde7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:52.407 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.386+0000 7fbe0b7fe640 1 --2- 10.20.193.77:0/1325212782 >> v2:10.20.193.119:6800/4127986552 conn(0x7fbddc03a310 0x7fbddc03c7d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009b30 tx=0x7fbdf8009340 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:52.463 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 1 -- 10.20.193.77:0/1325212782 --> v2:10.20.193.119:6800/4127986552 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe0c0ab0d0 con 0x7fbddc03a310 2026-02-17T12:07:52.464 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbde7fff640 1 -- 10.20.193.77:0/1325212782 <== mgr.4104 v2:10.20.193.119:6800/4127986552 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33986 (secure 0 0 0) 0x7fbe0c0ab0d0 con 0x7fbddc03a310 2026-02-17T12:07:52.465 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T12:07:52.466 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T12:07:52.466 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 1 -- 10.20.193.77:0/1325212782 >> v2:10.20.193.119:6800/4127986552 conn(0x7fbddc03a310 msgr2=0x7fbddc03c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:52.466 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 1 --2- 10.20.193.77:0/1325212782 >> v2:10.20.193.119:6800/4127986552 conn(0x7fbddc03a310 0x7fbddc03c7d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009b30 tx=0x7fbdf8009340 comp rx=0 tx=0).stop 2026-02-17T12:07:52.466 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 10 monclient: shutdown 2026-02-17T12:07:52.466 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:52.466 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 1 -- 10.20.193.77:0/1325212782 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbe0c0a4c20 msgr2=0x7fbe0c0a2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:52.467 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 1 --2- 10.20.193.77:0/1325212782 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbe0c0a4c20 0x7fbe0c0a2a10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c550 tx=0x7fbdfc00ca10 comp rx=0 tx=0).stop 2026-02-17T12:07:52.467 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 1 -- 10.20.193.77:0/1325212782 shutdown_connections 2026-02-17T12:07:52.467 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 1 --2- 10.20.193.77:0/1325212782 >> v2:10.20.193.119:6800/4127986552 conn(0x7fbddc03a310 0x7fbddc03c7d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:52.467 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 1 --2- 10.20.193.77:0/1325212782 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7fbe0c0a5040 0x7fbe0c0a2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:52.467 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 1 --2- 10.20.193.77:0/1325212782 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7fbe0c0a4c20 0x7fbe0c0a2a10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:52.467 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 1 --2- 10.20.193.77:0/1325212782 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7fbe0c09be20 0x7fbe0c131a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:52.467 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 1 -- 10.20.193.77:0/1325212782 >> 10.20.193.77:0/1325212782 conn(0x7fbe0c074ba0 msgr2=0x7fbe0c137cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:52.467 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 1 -- 10.20.193.77:0/1325212782 shutdown_connections 2026-02-17T12:07:52.467 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.458+0000 7fbe11efc640 1 -- 10.20.193.77:0/1325212782 wait complete. 2026-02-17T12:07:52.474 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2026-02-17T12:07:52.283079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":184168,"kb_used_data":1600,"kb_used_omap":9,"kb_used_meta":182454,"kb_avail":566046872,"statfs":{"total":579820584960,"available":579631996928,"internally_reserved":0,"allocated":1638400,"data_stored":1609924,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9561,"internal_metadata":186833575},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001161"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:07:32.951218+0000","last_change":"2026-02-17T12:07:32.951243+0000","last_active":"2026-02-17T12:07:32.951218+0000","last_peered":"2026-02-17T12:07:32.951218+0000","last_clean":"2026-02-17T12:07:32.951218+0000","last_became_active":"2026-02-17T12:05:12.276658+0000","last_became_peered":"2026-02-17T12:05:12.276658+0000","last_unstale":"2026-02-17T12:07:32.951218+0000","last_undegraded":"2026-02-17T12:07:32.951218+0000","last_fullsized":"2026-02-17T12:07:32.951218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:07:32.951146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:07:32.951146+0000","last_clean_scrub_stamp":"2026-02-17T12:07:32.951146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:20:57.529475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048223100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:07:30.229649+0000","last_change":"2026-02-17T12:07:30.229666+0000","last_active":"2026-02-17T12:07:30.229649+0000","last_peered":"2026-02-17T12:07:30.229649+0000","last_clean":"2026-02-17T12:07:30.229649+0000","last_became_active":"2026-02-17T12:05:12.278326+0000","last_became_peered":"2026-02-17T12:05:12.278326+0000","last_unstale":"2026-02-17T12:07:30.229649+0000","last_undegraded":"2026-02-17T12:07:30.229649+0000","last_fullsized":"2026-02-17T12:07:30.229649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:07:30.229591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:07:30.229591+0000","last_clean_scrub_stamp":"2026-02-17T12:07:30.229591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:38:49.580296+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.00031809399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:07:33.956817+0000","last_change":"2026-02-17T12:07:33.956832+0000","last_active":"2026-02-17T12:07:33.956817+0000","last_peered":"2026-02-17T12:07:33.956817+0000","last_clean":"2026-02-17T12:07:33.956817+0000","last_became_active":"2026-02-17T12:05:12.528026+0000","last_became_peered":"2026-02-17T12:05:12.528026+0000","last_unstale":"2026-02-17T12:07:33.956817+0000","last_undegraded":"2026-02-17T12:07:33.956817+0000","last_fullsized":"2026-02-17T12:07:33.956817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:07:33.956768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:07:33.956768+0000","last_clean_scrub_stamp":"2026-02-17T12:07:33.956768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:21:47.192330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039251500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:07:31.240487+0000","last_change":"2026-02-17T12:07:31.240510+0000","last_active":"2026-02-17T12:07:31.240487+0000","last_peered":"2026-02-17T12:07:31.240487+0000","last_clean":"2026-02-17T12:07:31.240487+0000","last_became_active":"2026-02-17T12:05:12.529966+0000","last_became_peered":"2026-02-17T12:05:12.529966+0000","last_unstale":"2026-02-17T12:07:31.240487+0000","last_undegraded":"2026-02-17T12:07:31.240487+0000","last_fullsized":"2026-02-17T12:07:31.240487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:07:31.240428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:07:31.240428+0000","last_clean_scrub_stamp":"2026-02-17T12:07:31.240428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:30:16.134772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033970499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"29'3","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:07:33.248176+0000","last_change":"2026-02-17T12:07:33.248197+0000","last_active":"2026-02-17T12:07:33.248176+0000","last_peered":"2026-02-17T12:07:33.248176+0000","last_clean":"2026-02-17T12:07:33.248176+0000","last_became_active":"2026-02-17T12:05:12.276436+0000","last_became_peered":"2026-02-17T12:05:12.276436+0000","last_unstale":"2026-02-17T12:07:33.248176+0000","last_undegraded":"2026-02-17T12:07:33.248176+0000","last_fullsized":"2026-02-17T12:07:33.248176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2026-02-17T12:07:33.248129+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2026-02-17T12:07:33.248129+0000","last_clean_scrub_stamp":"2026-02-17T12:07:33.248129+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:37:32.597951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054557800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:07:30.860043+0000","last_change":"2026-02-17T12:07:30.860061+0000","last_active":"2026-02-17T12:07:30.860043+0000","last_peered":"2026-02-17T12:07:30.860043+0000","last_clean":"2026-02-17T12:07:30.860043+0000","last_became_active":"2026-02-17T12:05:12.278426+0000","last_became_peered":"2026-02-17T12:05:12.278426+0000","last_unstale":"2026-02-17T12:07:30.860043+0000","last_undegraded":"2026-02-17T12:07:30.860043+0000","last_fullsized":"2026-02-17T12:07:30.860043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:07:30.859973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:07:30.859973+0000","last_clean_scrub_stamp":"2026-02-17T12:07:30.859973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:31:13.144036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032063000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:07:31.920579+0000","last_change":"2026-02-17T12:07:31.920606+0000","last_active":"2026-02-17T12:07:31.920579+0000","last_peered":"2026-02-17T12:07:31.920579+0000","last_clean":"2026-02-17T12:07:31.920579+0000","last_became_active":"2026-02-17T12:05:12.276579+0000","last_became_peered":"2026-02-17T12:05:12.276579+0000","last_unstale":"2026-02-17T12:07:31.920579+0000","last_undegraded":"2026-02-17T12:07:31.920579+0000","last_fullsized":"2026-02-17T12:07:31.920579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:07:31.920504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:07:31.920504+0000","last_clean_scrub_stamp":"2026-02-17T12:07:31.920504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:10:52.876580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000311976,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:07:32.222352+0000","last_change":"2026-02-17T12:07:32.222394+0000","last_active":"2026-02-17T12:07:32.222352+0000","last_peered":"2026-02-17T12:07:32.222352+0000","last_clean":"2026-02-17T12:07:32.222352+0000","last_became_active":"2026-02-17T12:05:12.276141+0000","last_became_peered":"2026-02-17T12:05:12.276141+0000","last_unstale":"2026-02-17T12:07:32.222352+0000","last_undegraded":"2026-02-17T12:07:32.222352+0000","last_fullsized":"2026-02-17T12:07:32.222352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2026-02-17T12:07:32.222255+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2026-02-17T12:07:32.222255+0000","last_clean_scrub_stamp":"2026-02-17T12:07:32.222255+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:23:11.610324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00025524199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'114","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T12:07:30.953340+0000","last_change":"2026-02-17T12:07:30.953369+0000","last_active":"2026-02-17T12:07:30.953340+0000","last_peered":"2026-02-17T12:07:30.953340+0000","last_clean":"2026-02-17T12:07:30.953340+0000","last_became_active":"2026-02-17T12:05:08.039610+0000","last_became_peered":"2026-02-17T12:05:08.039610+0000","last_unstale":"2026-02-17T12:07:30.953340+0000","last_undegraded":"2026-02-17T12:07:30.953340+0000","last_fullsized":"2026-02-17T12:07:30.953340+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'114","last_scrub_stamp":"2026-02-17T12:07:30.953279+0000","last_deep_scrub":"29'114","last_deep_scrub_stamp":"2026-02-17T12:07:30.953279+0000","last_clean_scrub_stamp":"2026-02-17T12:07:30.953279+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:34:46.261943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13700,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":258048,"data_stored":92024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607587,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":253952,"data_stored":92005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607587,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":307200,"data_stored":620933,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607587,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":253952,"data_stored":92005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607587,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":258048,"data_stored":92024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640292,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":307200,"data_stored":620933,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6850,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:07:52.476 DEBUG:teuthology.orchestra.run.trial077:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T12:07:52.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 10 monclient: get_monmap_and_config 2026-02-17T12:07:52.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 10 monclient: build_initial_monmap 2026-02-17T12:07:52.540 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 10 monclient: monmap: 2026-02-17T12:07:52.540 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:52.540 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:52.540 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:07:52.536137+0000 2026-02-17T12:07:52.541 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:07:52.536137+0000 2026-02-17T12:07:52.541 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:52.541 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:52.541 INFO:teuthology.orchestra.run.trial077.stderr:0: v1:10.20.193.77:6789/0 mon.noname-a-legacy 2026-02-17T12:07:52.541 INFO:teuthology.orchestra.run.trial077.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c-legacy 2026-02-17T12:07:52.541 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-b 2026-02-17T12:07:52.541 INFO:teuthology.orchestra.run.trial077.stderr:3: v2:10.20.193.77:3300/0 mon.noname-a 2026-02-17T12:07:52.541 INFO:teuthology.orchestra.run.trial077.stderr:4: v2:10.20.193.119:3300/0 mon.noname-c 2026-02-17T12:07:52.541 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:52.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 1 Processor -- start 2026-02-17T12:07:52.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 1 -- start start 2026-02-17T12:07:52.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 10 monclient: init 2026-02-17T12:07:52.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:52.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 10 monclient: _add_conns ranks=[1,4,3,0,2] 2026-02-17T12:07:52.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9fe00a2b80 addr v1:10.20.193.119:6789/0 2026-02-17T12:07:52.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 1 --2- >> v2:10.20.193.119:3300/0 conn(0x7f9fe009cf90 0x7f9fe009d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:52.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 10 monclient(hunting): picked mon.noname-c con 0x7f9fe009cf90 addr v2:10.20.193.119:3300/0 2026-02-17T12:07:52.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f9fe013d380 0x7f9fe013f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:52.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 10 monclient(hunting): picked mon.noname-a con 0x7f9fe013d380 addr v2:10.20.193.77:3300/0 2026-02-17T12:07:52.542 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe01353d0 con 0x7f9fe00a2b80 2026-02-17T12:07:52.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:52.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 1 -- --> v2:10.20.193.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe00a26e0 con 0x7f9fe013d380 2026-02-17T12:07:52.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:52.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 1 -- --> v2:10.20.193.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe009aac0 con 0x7f9fe009cf90 2026-02-17T12:07:52.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:52.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe6470640 10 monclient(hunting): authenticate will time out at 724.211516s 2026-02-17T12:07:52.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f9fe013d380 0x7f9fe013f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:52.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 1 --2- >> v2:10.20.193.77:3300/0 conn(0x7f9fe013d380 0x7f9fe013f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:49526/0 (socket says 10.20.193.77:49526) 2026-02-17T12:07:52.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 1 -- 10.20.193.77:0/2288812421 learned_addr learned my addr 10.20.193.77:0/2288812421 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:52.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 10 monclient(hunting): get_auth_request con 0x7f9fe013d380 auth_method 0 2026-02-17T12:07:52.543 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:52.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:52.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:52.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:52.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:52.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fdf7fe640 1 --2- 10.20.193.77:0/2288812421 >> v2:10.20.193.119:3300/0 conn(0x7f9fe009cf90 0x7f9fe009d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:52.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:52.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fdf7fe640 10 monclient(hunting): get_auth_request con 0x7f9fe009cf90 auth_method 0 2026-02-17T12:07:52.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fdf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:52.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fdf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:52.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fdf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:52.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 10 monclient(hunting): handle_auth_done global_id 4542 payload 274 2026-02-17T12:07:52.544 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 1 -- 10.20.193.77:0/2288812421 >> v2:10.20.193.119:3300/0 conn(0x7f9fe009cf90 msgr2=0x7f9fe009d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:52.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 1 --2- 10.20.193.77:0/2288812421 >> v2:10.20.193.119:3300/0 conn(0x7f9fe009cf90 0x7f9fe009d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:52.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 1 -- 10.20.193.77:0/2288812421 >> v1:10.20.193.119:6789/0 conn(0x7f9fe00a2b80 legacy=0x7f9fe0134cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T12:07:52.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 10 monclient: _finish_hunting 0 2026-02-17T12:07:52.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 1 monclient: found mon.noname-a 2026-02-17T12:07:52.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:52.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:52.545 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.530+0000 7f9fe49e6640 1 -- 10.20.193.77:0/2288812421 --> v2:10.20.193.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe009b1c0 con 0x7f9fe013d380 2026-02-17T12:07:52.552 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe49e6640 1 -- 10.20.193.77:0/2288812421 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fe013d380 msgr2=0x7f9fe013f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:52.552 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe49e6640 1 --2- 10.20.193.77:0/2288812421 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fe013d380 0x7f9fe013f770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00a3030 tx=0x7f9fd401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6ac096219eea server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:52.552 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fdeffd640 1 -- 10.20.193.77:0/2288812421 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40a5700 con 0x7f9fe013d380 2026-02-17T12:07:52.552 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fdeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:52.552 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fdeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:52.552 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fdeffd640 10 monclient: dump: 2026-02-17T12:07:52.553 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:52.553 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:52.553 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.553 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.553 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:52.553 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:52.553 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:52.553 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:52.553 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:52.553 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:52.554 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fdeffd640 10 monclient: _finish_auth 0 2026-02-17T12:07:52.554 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fdeffd640 10 monclient: _check_auth_tickets 2026-02-17T12:07:52.554 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fdeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:52.554 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fdeffd640 1 -- 10.20.193.77:0/2288812421 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd40a58a0 con 0x7f9fe013d380 2026-02-17T12:07:52.554 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fdeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:52.554 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe6470640 5 monclient: authenticate success, global_id 4542 2026-02-17T12:07:52.554 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fdeffd640 1 -- 10.20.193.77:0/2288812421 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40a5c70 con 0x7f9fe013d380 2026-02-17T12:07:52.554 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe6470640 10 monclient: get_monmap_and_config success 2026-02-17T12:07:52.554 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fdeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:52.554 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe6470640 4 set_mon_vals no callback set 2026-02-17T12:07:52.555 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fdeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:52.555 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fdeffd640 10 monclient: dump: 2026-02-17T12:07:52.555 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:52.555 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:52.555 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.555 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.555 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:52.555 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:52.555 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:52.555 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:52.556 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:52.556 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:52.556 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe6470640 10 monclient: shutdown 2026-02-17T12:07:52.556 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe6470640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:52.556 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe6470640 1 -- 10.20.193.77:0/2288812421 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fe013d380 msgr2=0x7f9fe013f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:52.556 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe6470640 1 --2- 10.20.193.77:0/2288812421 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fe013d380 0x7f9fe013f770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00a3030 tx=0x7f9fd401c880 comp rx=0 tx=0).stop 2026-02-17T12:07:52.556 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe6470640 1 -- 10.20.193.77:0/2288812421 shutdown_connections 2026-02-17T12:07:52.556 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe6470640 1 --2- 10.20.193.77:0/2288812421 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fe013d380 0x7f9fe013f770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:52.556 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe6470640 1 --2- 10.20.193.77:0/2288812421 >> v2:10.20.193.119:3300/0 conn(0x7f9fe009cf90 0x7f9fe009d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:52.556 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe6470640 1 -- 10.20.193.77:0/2288812421 >> 10.20.193.77:0/2288812421 conn(0x7f9fe00a3290 msgr2=0x7f9fe00a36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:52.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe6470640 1 -- 10.20.193.77:0/2288812421 shutdown_connections 2026-02-17T12:07:52.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.534+0000 7f9fe6470640 1 -- 10.20.193.77:0/2288812421 wait complete. 2026-02-17T12:07:52.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient: build_initial_monmap 2026-02-17T12:07:52.557 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient: monmap: 2026-02-17T12:07:52.557 INFO:teuthology.orchestra.run.trial077.stderr:epoch 0 2026-02-17T12:07:52.557 INFO:teuthology.orchestra.run.trial077.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T12:07:52.557 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 0.000000 2026-02-17T12:07:52.557 INFO:teuthology.orchestra.run.trial077.stderr:created 0.000000 2026-02-17T12:07:52.557 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 0 (unknown) 2026-02-17T12:07:52.557 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:52.558 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.noname-a 2026-02-17T12:07:52.558 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.noname-b 2026-02-17T12:07:52.558 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.noname-c 2026-02-17T12:07:52.558 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:52.558 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 1 Processor -- start 2026-02-17T12:07:52.558 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 1 -- start start 2026-02-17T12:07:52.558 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient: init 2026-02-17T12:07:52.558 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient: _reopen_session rank -1 2026-02-17T12:07:52.558 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T12:07:52.558 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fe009cf90 0x7f9fe01d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:52.558 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient(hunting): picked mon.noname-a con 0x7f9fe009cf90 addr [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] 2026-02-17T12:07:52.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 1 --2- >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9fe00a2b80 0x7f9fe0131ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:52.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient(hunting): picked mon.noname-b con 0x7f9fe00a2b80 addr [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] 2026-02-17T12:07:52.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 1 --2- >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9fe013d380 0x7f9fe01320e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:52.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient(hunting): picked mon.noname-c con 0x7f9fe013d380 addr [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] 2026-02-17T12:07:52.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:52.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 1 -- --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe0142980 con 0x7f9fe009cf90 2026-02-17T12:07:52.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:52.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 1 -- --> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe0142800 con 0x7f9fe00a2b80 2026-02-17T12:07:52.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient(hunting): start opening mon connection 2026-02-17T12:07:52.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 1 -- --> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe0142b00 con 0x7f9fe013d380 2026-02-17T12:07:52.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient(hunting): _renew_subs 2026-02-17T12:07:52.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient(hunting): authenticate will time out at 724.216998s 2026-02-17T12:07:52.559 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fe009cf90 0x7f9fe01d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:52.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 1 --2- >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fe009cf90 0x7f9fe01d1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.77:3300/0 says I am v2:10.20.193.77:49528/0 (socket says 10.20.193.77:49528) 2026-02-17T12:07:52.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 1 -- 10.20.193.77:0/2652624481 learned_addr learned my addr 10.20.193.77:0/2652624481 (peer_addr_for_me v2:10.20.193.77:0/0) 2026-02-17T12:07:52.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 10 monclient(hunting): get_auth_request con 0x7f9fe009cf90 auth_method 0 2026-02-17T12:07:52.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:52.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:52.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:52.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe49e6640 1 --2- 10.20.193.77:0/2652624481 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9fe013d380 0x7f9fe01320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:52.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe49e6640 10 monclient(hunting): get_auth_request con 0x7f9fe013d380 auth_method 0 2026-02-17T12:07:52.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe49e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:52.560 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe49e6640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:52.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe49e6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:52.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:52.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:52.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:52.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe49e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T12:07:52.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe49e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T12:07:52.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe49e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T12:07:52.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdf7fe640 1 --2- 10.20.193.77:0/2652624481 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9fe00a2b80 0x7f9fe0131ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:52.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdf7fe640 10 monclient(hunting): get_auth_request con 0x7f9fe00a2b80 auth_method 0 2026-02-17T12:07:52.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T12:07:52.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T12:07:52.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T12:07:52.561 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 10 monclient(hunting): handle_auth_done global_id 4545 payload 824 2026-02-17T12:07:52.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 1 -- 10.20.193.77:0/2652624481 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9fe013d380 msgr2=0x7f9fe01320e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:52.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 1 --2- 10.20.193.77:0/2652624481 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9fe013d380 0x7f9fe01320e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:52.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 1 -- 10.20.193.77:0/2652624481 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9fe00a2b80 msgr2=0x7f9fe0131ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:52.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 1 --2- 10.20.193.77:0/2652624481 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9fe00a2b80 0x7f9fe0131ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:52.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 10 monclient: _finish_hunting 0 2026-02-17T12:07:52.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 1 monclient: found mon.noname-a 2026-02-17T12:07:52.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T12:07:52.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.77:3300/0 2026-02-17T12:07:52.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 1 -- 10.20.193.77:0/2652624481 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe0132e00 con 0x7f9fe009cf90 2026-02-17T12:07:52.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe49e6640 1 --2- 10.20.193.77:0/2652624481 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9fe013d380 0x7f9fe01320e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T12:07:52.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 1 -- 10.20.193.77:0/2652624481 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fe009cf90 msgr2=0x7f9fe01d1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-17T12:07:52.562 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdffff640 1 --2- 10.20.193.77:0/2652624481 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fe009cf90 0x7f9fe01d1d00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00c580 tx=0x7f9fcc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:52.563 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdcff9640 1 -- 10.20.193.77:0/2652624481 <== mon.0 v2:10.20.193.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc016020 con 0x7f9fe009cf90 2026-02-17T12:07:52.563 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:52.563 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T12:07:52.563 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdcff9640 10 monclient: dump: 2026-02-17T12:07:52.563 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:52.563 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:52.563 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.563 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.563 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:52.563 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:52.563 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:52.563 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:52.564 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:52.564 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:52.564 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdcff9640 10 monclient: _finish_auth 0 2026-02-17T12:07:52.564 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdcff9640 10 monclient: _check_auth_tickets 2026-02-17T12:07:52.564 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T12:07:52.564 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdcff9640 1 -- 10.20.193.77:0/2652624481 <== mon.0 v2:10.20.193.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fcc012a60 con 0x7f9fe009cf90 2026-02-17T12:07:52.564 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 5 monclient: authenticate success, global_id 4545 2026-02-17T12:07:52.564 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient: _renew_subs 2026-02-17T12:07:52.564 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:52.564 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 1 -- 10.20.193.77:0/2652624481 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe013f780 con 0x7f9fe009cf90 2026-02-17T12:07:52.564 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T12:07:52.564 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdcff9640 1 -- 10.20.193.77:0/2652624481 <== mon.0 v2:10.20.193.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc012e50 con 0x7f9fe009cf90 2026-02-17T12:07:52.565 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T12:07:52.565 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T12:07:52.565 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fdcff9640 10 monclient: dump: 2026-02-17T12:07:52.565 INFO:teuthology.orchestra.run.trial077.stderr:epoch 1 2026-02-17T12:07:52.565 INFO:teuthology.orchestra.run.trial077.stderr:fsid 093d53f2-7cd0-4506-a27d-4c950e190615 2026-02-17T12:07:52.565 INFO:teuthology.orchestra.run.trial077.stderr:last_changed 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.565 INFO:teuthology.orchestra.run.trial077.stderr:created 2026-02-17T12:04:22.035180+0000 2026-02-17T12:07:52.565 INFO:teuthology.orchestra.run.trial077.stderr:min_mon_release 19 (squid) 2026-02-17T12:07:52.565 INFO:teuthology.orchestra.run.trial077.stderr:election_strategy: 1 2026-02-17T12:07:52.565 INFO:teuthology.orchestra.run.trial077.stderr:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T12:07:52.565 INFO:teuthology.orchestra.run.trial077.stderr:1: [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] mon.b 2026-02-17T12:07:52.565 INFO:teuthology.orchestra.run.trial077.stderr:2: [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] mon.c 2026-02-17T12:07:52.565 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:07:52.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fde7fc640 4 set_mon_vals no callback set 2026-02-17T12:07:52.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient: _renew_subs 2026-02-17T12:07:52.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:52.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.538+0000 7f9fe6470640 1 -- 10.20.193.77:0/2652624481 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe01300b0 con 0x7f9fe009cf90 2026-02-17T12:07:52.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.542+0000 7f9fe6470640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:52.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.542+0000 7f9fe6470640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:52.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.542+0000 7f9fe6470640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:52.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.542+0000 7f9fe6470640 1 -- 10.20.193.77:0/2652624481 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe009d3a0 con 0x7f9fe009cf90 2026-02-17T12:07:52.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.542+0000 7f9fdcff9640 1 -- 10.20.193.77:0/2652624481 <== mon.0 v2:10.20.193.77:3300/0 4 ==== mgrmap(e 5) ==== 47456+0+0 (secure 0 0 0) 0x7f9fcc01b400 con 0x7f9fe009cf90 2026-02-17T12:07:52.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.542+0000 7f9fdcff9640 1 --2- 10.20.193.77:0/2652624481 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9fb003a2c0 0x7f9fb003c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:07:52.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.542+0000 7f9fdcff9640 1 -- 10.20.193.77:0/2652624481 <== mon.0 v2:10.20.193.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3502+0+0 (secure 0 0 0) 0x7f9fcc04dd10 con 0x7f9fe009cf90 2026-02-17T12:07:52.566 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.542+0000 7f9fdf7fe640 1 --2- 10.20.193.77:0/2652624481 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9fb003a2c0 0x7f9fb003c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:07:52.567 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.542+0000 7f9fdf7fe640 10 monclient: get_auth_request con 0x7f9fb003a2c0 auth_method 0 2026-02-17T12:07:52.567 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.542+0000 7f9fdcff9640 1 -- 10.20.193.77:0/2652624481 <== mon.0 v2:10.20.193.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186389 (secure 0 0 0) 0x7f9fcc054080 con 0x7f9fe009cf90 2026-02-17T12:07:52.567 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.542+0000 7f9fdcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T12:07:52.567 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.542+0000 7f9fdcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T12:07:52.567 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.542+0000 7f9fdf7fe640 1 --2- 10.20.193.77:0/2652624481 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9fb003a2c0 0x7f9fb003c780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9fe012de70 tx=0x7f9fd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:07:52.625 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.618+0000 7f9fe6470640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T12:07:52.626 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.618+0000 7f9fe6470640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T12:07:52.626 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.618+0000 7f9fe6470640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.77:3300/0 2026-02-17T12:07:52.626 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:52.618+0000 7f9fe6470640 1 -- 10.20.193.77:0/2652624481 --> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f9fe012e8b0 con 0x7f9fe009cf90 2026-02-17T12:07:53.100 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fdcff9640 1 -- 10.20.193.77:0/2652624481 <== mon.0 v2:10.20.193.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v7)=0 v7) ==== 123+0+0 (secure 0 0 0) 0x7f9fcc020020 con 0x7f9fe009cf90 2026-02-17T12:07:53.101 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fdcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T12:07:53.101 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fdcff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T12:07:53.102 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fdcff9640 1 -- 10.20.193.77:0/2652624481 <== mon.0 v2:10.20.193.77:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9fcc01b900 con 0x7f9fe009cf90 2026-02-17T12:07:53.102 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fdcff9640 10 monclient: handle_config config(1 keys) 2026-02-17T12:07:53.102 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fddffb640 4 set_mon_vals no callback set 2026-02-17T12:07:53.102 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fddffb640 10 set_mon_vals mon_health_to_clog = false 2026-02-17T12:07:53.102 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fe6470640 1 -- 10.20.193.77:0/2652624481 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9fb003a2c0 msgr2=0x7f9fb003c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:53.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fe6470640 1 --2- 10.20.193.77:0/2652624481 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9fb003a2c0 0x7f9fb003c780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9fe012de70 tx=0x7f9fd0008040 comp rx=0 tx=0).stop 2026-02-17T12:07:53.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fe6470640 10 monclient: shutdown 2026-02-17T12:07:53.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fe6470640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T12:07:53.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fe6470640 1 -- 10.20.193.77:0/2652624481 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fe009cf90 msgr2=0x7f9fe01d1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:07:53.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fe6470640 1 --2- 10.20.193.77:0/2652624481 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fe009cf90 0x7f9fe01d1d00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00c580 tx=0x7f9fcc00ca40 comp rx=0 tx=0).stop 2026-02-17T12:07:53.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fe6470640 1 -- 10.20.193.77:0/2652624481 shutdown_connections 2026-02-17T12:07:53.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fe6470640 1 --2- 10.20.193.77:0/2652624481 >> v2:10.20.193.119:6800/4127986552 conn(0x7f9fb003a2c0 0x7f9fb003c780 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:53.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fe6470640 1 --2- 10.20.193.77:0/2652624481 >> [v2:10.20.193.77:3301/0,v1:10.20.193.77:6790/0] conn(0x7f9fe013d380 0x7f9fe01320e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:53.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fe6470640 1 --2- 10.20.193.77:0/2652624481 >> [v2:10.20.193.119:3300/0,v1:10.20.193.119:6789/0] conn(0x7f9fe00a2b80 0x7f9fe0131ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:53.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fe6470640 1 --2- 10.20.193.77:0/2652624481 >> [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] conn(0x7f9fe009cf90 0x7f9fe01d1d00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:07:53.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fe6470640 1 -- 10.20.193.77:0/2652624481 >> 10.20.193.77:0/2652624481 conn(0x7f9fe00a3290 msgr2=0x7f9fe0073c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:07:53.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fe6470640 1 -- 10.20.193.77:0/2652624481 shutdown_connections 2026-02-17T12:07:53.103 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T12:07:53.094+0000 7f9fe6470640 1 -- 10.20.193.77:0/2652624481 wait complete. 2026-02-17T12:07:53.111 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T12:07:53.111 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T12:07:53.112 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T12:07:53.112 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:07:53.184 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T12:07:53.184 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T12:07:53.184 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:07:53.244 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T12:07:53.244 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T12:07:53.244 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:07:55.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-17T12:07:59.345 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T12:07:59.346 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-17T12:07:59.346 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:07:59.427 INFO:tasks.ceph.osd.3:Stopped 2026-02-17T12:07:59.428 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-17T12:07:59.428 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:07:59.516 INFO:tasks.ceph.osd.4:Stopped 2026-02-17T12:07:59.517 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-17T12:07:59.517 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:07:59.605 INFO:tasks.ceph.osd.5:Stopped 2026-02-17T12:07:59.605 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T12:07:59.606 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T12:07:59.606 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:07:59.632 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T12:07:59.632 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T12:07:59.633 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T12:07:59.633 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:07:59.647 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T12:07:59.648 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T12:07:59.648 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:07:59.707 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T12:07:59.707 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T12:07:59.707 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:07:59.718 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T12:07:59.719 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T12:07:59.719 DEBUG:teuthology.orchestra.run.trial077:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | head -n 1 2026-02-17T12:07:59.761 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial077.front.sepia.ceph.com 2026-02-17T12:07:59.762 DEBUG:teuthology.orchestra.run.trial077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T12:07:59.814 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial077.front.sepia.ceph.com 2026-02-17T12:07:59.814 DEBUG:teuthology.orchestra.run.trial077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T12:07:59.867 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial077.front.sepia.ceph.com 2026-02-17T12:07:59.868 DEBUG:teuthology.orchestra.run.trial077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T12:07:59.924 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial119.front.sepia.ceph.com 2026-02-17T12:07:59.925 DEBUG:teuthology.orchestra.run.trial119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-17T12:07:59.939 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial119.front.sepia.ceph.com 2026-02-17T12:07:59.939 DEBUG:teuthology.orchestra.run.trial119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-17T12:07:59.991 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial119.front.sepia.ceph.com 2026-02-17T12:07:59.992 DEBUG:teuthology.orchestra.run.trial119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-17T12:08:00.043 INFO:tasks.ceph:Archiving mon data... 2026-02-17T12:08:00.045 DEBUG:teuthology.misc:Transferring archived files from trial077:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51399/data/mon.a.tgz 2026-02-17T12:08:00.045 DEBUG:teuthology.orchestra.run.trial077:> mktemp 2026-02-17T12:08:00.050 INFO:teuthology.orchestra.run.trial077.stdout:/tmp/tmp.kK0aDnO8oy 2026-02-17T12:08:00.050 DEBUG:teuthology.orchestra.run.trial077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.kK0aDnO8oy 2026-02-17T12:08:00.110 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod 0666 /tmp/tmp.kK0aDnO8oy 2026-02-17T12:08:00.212 DEBUG:teuthology.orchestra.remote:trial077:/tmp/tmp.kK0aDnO8oy is 106KB 2026-02-17T12:08:00.223 DEBUG:teuthology.orchestra.run.trial077:> rm -fr /tmp/tmp.kK0aDnO8oy 2026-02-17T12:08:00.227 DEBUG:teuthology.misc:Transferring archived files from trial077:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51399/data/mon.c.tgz 2026-02-17T12:08:00.227 DEBUG:teuthology.orchestra.run.trial077:> mktemp 2026-02-17T12:08:00.279 INFO:teuthology.orchestra.run.trial077.stdout:/tmp/tmp.lcr1mlsHyp 2026-02-17T12:08:00.279 DEBUG:teuthology.orchestra.run.trial077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.lcr1mlsHyp 2026-02-17T12:08:00.348 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod 0666 /tmp/tmp.lcr1mlsHyp 2026-02-17T12:08:00.444 DEBUG:teuthology.orchestra.remote:trial077:/tmp/tmp.lcr1mlsHyp is 106KB 2026-02-17T12:08:00.454 DEBUG:teuthology.orchestra.run.trial077:> rm -fr /tmp/tmp.lcr1mlsHyp 2026-02-17T12:08:00.459 DEBUG:teuthology.misc:Transferring archived files from trial119:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51399/data/mon.b.tgz 2026-02-17T12:08:00.459 DEBUG:teuthology.orchestra.run.trial119:> mktemp 2026-02-17T12:08:00.464 INFO:teuthology.orchestra.run.trial119.stdout:/tmp/tmp.GLcMGT6KoR 2026-02-17T12:08:00.464 DEBUG:teuthology.orchestra.run.trial119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.GLcMGT6KoR 2026-02-17T12:08:00.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-17T12:08:00.530 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 0666 /tmp/tmp.GLcMGT6KoR 2026-02-17T12:08:00.625 DEBUG:teuthology.orchestra.remote:trial119:/tmp/tmp.GLcMGT6KoR is 105KB 2026-02-17T12:08:00.637 DEBUG:teuthology.orchestra.run.trial119:> rm -fr /tmp/tmp.GLcMGT6KoR 2026-02-17T12:08:00.642 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T12:08:00.642 DEBUG:teuthology.orchestra.run.trial077:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T12:08:00.644 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T12:08:00.698 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T12:08:00.739 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T12:08:00.740 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T12:08:00.742 DEBUG:teuthology.misc:Transferring archived files from trial077:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51399/remote/trial077/crash 2026-02-17T12:08:00.743 DEBUG:teuthology.orchestra.run.trial077:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T12:08:00.753 DEBUG:teuthology.misc:Transferring archived files from trial119:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51399/remote/trial119/crash 2026-02-17T12:08:00.754 DEBUG:teuthology.orchestra.run.trial119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T12:08:00.792 INFO:tasks.ceph:Compressing logs... 2026-02-17T12:08:00.792 DEBUG:teuthology.orchestra.run.trial077:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:08:00.799 DEBUG:teuthology.orchestra.run.trial119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:08:00.807 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18468.log 2026-02-17T12:08:00.810 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19945.log 2026-02-17T12:08:00.810 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15658.log 2026-02-17T12:08:00.810 INFO:teuthology.orchestra.run.trial077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.18468.log.gz 2026-02-17T12:08:00.810 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18303.log 2026-02-17T12:08:00.810 INFO:teuthology.orchestra.run.trial077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.19945.log.gz 2026-02-17T12:08:00.810 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.15658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19049.log 2026-02-17T12:08:00.810 INFO:teuthology.orchestra.run.trial077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.15658.log.gz 2026-02-17T12:08:00.810 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18766.log 2026-02-17T12:08:00.810 INFO:teuthology.orchestra.run.trial077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.18303.log.gz 2026-02-17T12:08:00.810 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18353.log 2026-02-17T12:08:00.811 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19049.log: /var/log/ceph/ceph-client.admin.18766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19427.log 2026-02-17T12:08:00.811 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18353.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.19049.log.gz 2026-02-17T12:08:00.811 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19713.log 2026-02-17T12:08:00.811 INFO:teuthology.orchestra.run.trial077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.18766.log.gz 2026-02-17T12:08:00.811 INFO:teuthology.orchestra.run.trial077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.18353.log.gz 2026-02-17T12:08:00.811 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18622.log 2026-02-17T12:08:00.811 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15624.log 2026-02-17T12:08:00.811 INFO:teuthology.orchestra.run.trial077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.19427.log.gz 2026-02-17T12:08:00.822 INFO:teuthology.orchestra.run.trial077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.19713.log.gz 2026-02-17T12:08:00.822 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19609.log 2026-02-17T12:08:00.822 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18622.log: /var/log/ceph/ceph-client.admin.15624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18467.log 2026-02-17T12:08:00.822 INFO:teuthology.orchestra.run.trial077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.18622.log.gz 2026-02-17T12:08:00.822 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18971.log 2026-02-17T12:08:00.822 INFO:teuthology.orchestra.run.trial077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.15624.log.gz 2026-02-17T12:08:00.822 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19479.log 2026-02-17T12:08:00.823 INFO:teuthology.orchestra.run.trial077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.19609.log.gz 2026-02-17T12:08:00.823 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18971.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.18467.log.gz 2026-02-17T12:08:00.823 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18466.log 2026-02-17T12:08:00.823 INFO:teuthology.orchestra.run.trial077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.18971.log.gz 2026-02-17T12:08:00.823 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18373.log 2026-02-17T12:08:00.823 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19557.log 2026-02-17T12:08:00.823 INFO:teuthology.orchestra.run.trial077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.19479.log.gz 2026-02-17T12:08:00.823 INFO:teuthology.orchestra.run.trial077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.18466.log.gz 2026-02-17T12:08:00.823 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18373.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.11864.log 2026-02-17T12:08:00.823 INFO:teuthology.orchestra.run.trial077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.18373.log.gz 2026-02-17T12:08:00.823 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19233.log 2026-02-17T12:08:00.823 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph.tmp-client.admin.11864.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.19557.log.gz 2026-02-17T12:08:00.824 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.11864.log.gz 2026-02-17T12:08:00.824 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19023.log 2026-02-17T12:08:00.824 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18399.log 2026-02-17T12:08:00.824 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19023.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.19233.log.gz 2026-02-17T12:08:00.824 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19375.log 2026-02-17T12:08:00.824 INFO:teuthology.orchestra.run.trial077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.19023.log.gz 2026-02-17T12:08:00.824 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19921.log 2026-02-17T12:08:00.824 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18399.log: /var/log/ceph/ceph-client.admin.19375.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T12:08:00.824 INFO:teuthology.orchestra.run.trial077.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.19375.log.gz 2026-02-17T12:08:00.824 INFO:teuthology.orchestra.run.trial077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.18399.log.gz 2026-02-17T12:08:00.824 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19453.log 2026-02-17T12:08:00.824 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19921.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19207.log 2026-02-17T12:08:00.825 INFO:teuthology.orchestra.run.trial077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.19921.log.gz 2026-02-17T12:08:00.825 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18471.log 2026-02-17T12:08:00.825 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18774.log 2026-02-17T12:08:00.825 INFO:teuthology.orchestra.run.trial077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.19453.log.gz 2026-02-17T12:08:00.825 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18471.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.19207.log.gz 2026-02-17T12:08:00.825 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19127.log 2026-02-17T12:08:00.825 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18328.log 2026-02-17T12:08:00.825 INFO:teuthology.orchestra.run.trial077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.18471.log.gz 2026-02-17T12:08:00.825 INFO:teuthology.orchestra.run.trial077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.18774.log.gz 2026-02-17T12:08:00.825 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18247.log 2026-02-17T12:08:00.825 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19349.log 2026-02-17T12:08:00.825 INFO:teuthology.orchestra.run.trial077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.19127.log.gz 2026-02-17T12:08:00.826 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19531.log 2026-02-17T12:08:00.826 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18247.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.18328.log.gz 2026-02-17T12:08:00.826 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18624.log 2026-02-17T12:08:00.826 INFO:teuthology.orchestra.run.trial077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.18247.log.gz 2026-02-17T12:08:00.826 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19869.log 2026-02-17T12:08:00.826 INFO:teuthology.orchestra.run.trial077.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.19349.log.gz 2026-02-17T12:08:00.826 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19323.log 2026-02-17T12:08:00.826 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18624.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.19531.log.gz 2026-02-17T12:08:00.826 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19261.log 2026-02-17T12:08:00.826 INFO:teuthology.orchestra.run.trial077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.18624.log.gz 2026-02-17T12:08:00.826 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19635.log 2026-02-17T12:08:00.826 INFO:teuthology.orchestra.run.trial077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.19869.log.gz 2026-02-17T12:08:00.826 INFO:teuthology.orchestra.run.trial077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.19323.log.gz 2026-02-17T12:08:00.827 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18626.log 2026-02-17T12:08:00.827 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19261.log: /var/log/ceph/ceph-client.admin.19635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15532.log 2026-02-17T12:08:00.827 INFO:teuthology.orchestra.run.trial077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.19635.log.gz 2026-02-17T12:08:00.827 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19895.log 2026-02-17T12:08:00.827 INFO:teuthology.orchestra.run.trial077.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.19261.log.gz 2026-02-17T12:08:00.827 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.15532.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T12:08:00.827 INFO:teuthology.orchestra.run.trial077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.18626.log.gz 2026-02-17T12:08:00.827 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18425.log 2026-02-17T12:08:00.827 INFO:teuthology.orchestra.run.trial077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.19895.log.gz 2026-02-17T12:08:00.827 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T12:08:00.827 INFO:teuthology.orchestra.run.trial077.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.15532.log.gz 2026-02-17T12:08:00.827 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19505.log 2026-02-17T12:08:00.827 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18425.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-17T12:08:00.828 INFO:teuthology.orchestra.run.trial077.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T12:08:00.828 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19505.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.18425.log.gz 2026-02-17T12:08:00.828 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19287.log 2026-02-17T12:08:00.828 INFO:teuthology.orchestra.run.trial077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.19505.log.gz 2026-02-17T12:08:00.828 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18893.log 2026-02-17T12:08:00.828 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19791.log 2026-02-17T12:08:00.828 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19287.log: /var/log/ceph/ceph-client.admin.18893.log: 89.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.19287.log.gz -5 2026-02-17T12:08:00.828 INFO:teuthology.orchestra.run.trial077.stderr: --verbose -- /var/log/ceph/ceph.log 2026-02-17T12:08:00.828 INFO:teuthology.orchestra.run.trial077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.18893.log.gz 2026-02-17T12:08:00.836 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19101.log 2026-02-17T12:08:00.836 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19739.log 2026-02-17T12:08:00.836 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.19101.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.19791.log.gz 2026-02-17T12:08:00.836 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18945.log 2026-02-17T12:08:00.836 INFO:teuthology.orchestra.run.trial077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.19101.log.gz 2026-02-17T12:08:00.836 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19817.log 2026-02-17T12:08:00.836 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18469.log 2026-02-17T12:08:00.836 INFO:teuthology.orchestra.run.trial077.stderr: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T12:08:00.836 INFO:teuthology.orchestra.run.trial077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.19739.log.gz 2026-02-17T12:08:00.837 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19765.log 2026-02-17T12:08:00.837 INFO:teuthology.orchestra.run.trial077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.18945.log.gz 2026-02-17T12:08:00.837 INFO:teuthology.orchestra.run.trial077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.19817.log.gz 2026-02-17T12:08:00.837 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18627.log 2026-02-17T12:08:00.837 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18997.log 2026-02-17T12:08:00.837 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19765.log: 88.4%/var/log/ceph/ceph-client.admin.18627.log: -- replaced with /var/log/ceph/ceph-client.admin.18469.log.gz 2026-02-17T12:08:00.837 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18919.log 2026-02-17T12:08:00.837 INFO:teuthology.orchestra.run.trial077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.19765.log.gz 2026-02-17T12:08:00.837 INFO:teuthology.orchestra.run.trial077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.18627.log.gz 2026-02-17T12:08:00.837 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19843.log 2026-02-17T12:08:00.837 INFO:teuthology.orchestra.run.trial077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.18997.log.gz 2026-02-17T12:08:00.837 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19687.log 2026-02-17T12:08:00.837 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18919.log: /var/log/ceph/ceph-client.admin.19843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19583.log 2026-02-17T12:08:00.837 INFO:teuthology.orchestra.run.trial077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.18919.log.gz 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19687.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.19843.log.gz 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18767.log 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.19687.log.gz 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19181.log 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.19583.log.gz 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18775.log 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18767.log: /var/log/ceph/ceph-client.admin.19181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18867.log 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.18767.log.gz 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.19181.log.gz 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18775.log: /var/log/ceph/ceph-client.admin.18867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19401.log 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.18775.log.gz 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.18867.log.gz 2026-02-17T12:08:00.838 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18470.log 2026-02-17T12:08:00.839 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19075.log 2026-02-17T12:08:00.839 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19661.log 2026-02-17T12:08:00.839 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18470.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.19401.log.gz 2026-02-17T12:08:00.839 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19155.log 2026-02-17T12:08:00.839 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19661.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.19075.log.gz 2026-02-17T12:08:00.839 INFO:teuthology.orchestra.run.trial077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.18470.log.gz 2026-02-17T12:08:00.839 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18625.log 2026-02-17T12:08:00.839 INFO:teuthology.orchestra.run.trial077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.19661.log.gz 2026-02-17T12:08:00.839 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18623.log 2026-02-17T12:08:00.839 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.19155.log: /var/log/ceph/ceph-client.admin.18625.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.18625.log.gz 2026-02-17T12:08:00.839 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.18623.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.19155.log.gz 2026-02-17T12:08:00.839 INFO:teuthology.orchestra.run.trial077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.18623.log.gz 2026-02-17T12:08:00.847 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15526.log 2026-02-17T12:08:00.849 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-17T12:08:00.849 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15526.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-17T12:08:00.849 INFO:teuthology.orchestra.run.trial119.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.15526.log.gz 2026-02-17T12:08:00.849 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-17T12:08:00.849 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15575.log 2026-02-17T12:08:00.850 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T12:08:00.850 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15502.log 2026-02-17T12:08:00.851 INFO:teuthology.orchestra.run.trial119.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.15575.log.gz 2026-02-17T12:08:00.851 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15478.log 2026-02-17T12:08:00.851 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15502.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T12:08:00.851 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18345.log 88.7% 2026-02-17T12:08:00.851 INFO:teuthology.orchestra.run.trial119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.15502.log.gz 2026-02-17T12:08:00.852 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T12:08:00.852 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph.audit.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.15478.log.gz 2026-02-17T12:08:00.852 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.18345.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-17T12:08:00.853 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15454.log 2026-02-17T12:08:00.853 INFO:teuthology.orchestra.run.trial119.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T12:08:00.853 INFO:teuthology.orchestra.run.trial119.stderr: 85.0% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T12:08:00.853 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15551.log 2026-02-17T12:08:00.853 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18346.log 2026-02-17T12:08:00.853 INFO:teuthology.orchestra.run.trial119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.18345.log.gz 2026-02-17T12:08:00.853 INFO:teuthology.orchestra.run.trial119.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.15454.log.gz 2026-02-17T12:08:00.853 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18380.log 2026-02-17T12:08:00.853 INFO:teuthology.orchestra.run.trial077.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-17T12:08:00.854 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.18346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18381.log 2026-02-17T12:08:00.854 INFO:teuthology.orchestra.run.trial119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.15551.log.gz 2026-02-17T12:08:00.854 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.18380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18382.log 2026-02-17T12:08:00.855 INFO:teuthology.orchestra.run.trial119.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.18346.log.gz 2026-02-17T12:08:00.855 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.18381.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.18381.log.gz 2026-02-17T12:08:00.855 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.18382.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.18380.log.gz 2026-02-17T12:08:00.855 INFO:teuthology.orchestra.run.trial119.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.18382.log.gz 2026-02-17T12:08:00.869 INFO:teuthology.orchestra.run.trial119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T12:08:00.880 INFO:teuthology.orchestra.run.trial119.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-17T12:08:00.880 INFO:teuthology.orchestra.run.trial077.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T12:08:00.943 INFO:teuthology.orchestra.run.trial119.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-17T12:08:01.114 INFO:teuthology.orchestra.run.trial077.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T12:08:01.138 INFO:teuthology.orchestra.run.trial077.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T12:08:01.145 INFO:teuthology.orchestra.run.trial077.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T12:08:01.147 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T12:08:01.147 INFO:teuthology.orchestra.run.trial077.stderr:real 0m0.346s 2026-02-17T12:08:01.148 INFO:teuthology.orchestra.run.trial077.stderr:user 0m1.047s 2026-02-17T12:08:01.148 INFO:teuthology.orchestra.run.trial077.stderr:sys 0m0.067s 2026-02-17T12:08:01.149 INFO:teuthology.orchestra.run.trial119.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-17T12:08:01.157 INFO:teuthology.orchestra.run.trial119.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-17T12:08:01.158 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-17T12:08:01.158 INFO:teuthology.orchestra.run.trial119.stderr:real 0m0.316s 2026-02-17T12:08:01.158 INFO:teuthology.orchestra.run.trial119.stderr:user 0m0.732s 2026-02-17T12:08:01.158 INFO:teuthology.orchestra.run.trial119.stderr:sys 0m0.052s 2026-02-17T12:08:01.159 INFO:tasks.ceph:Archiving logs... 2026-02-17T12:08:01.159 DEBUG:teuthology.misc:Transferring archived files from trial077:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51399/remote/trial077/log 2026-02-17T12:08:01.160 DEBUG:teuthology.orchestra.run.trial077:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T12:08:01.383 DEBUG:teuthology.misc:Transferring archived files from trial119:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51399/remote/trial119/log 2026-02-17T12:08:01.383 DEBUG:teuthology.orchestra.run.trial119:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T12:08:01.463 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T12:08:01.469 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T12:08:01.469 DEBUG:teuthology.orchestra.run.trial077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T12:08:01.470 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T12:08:01.614 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T12:08:01.626 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T12:08:01.626 DEBUG:teuthology.orchestra.run.trial077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:08:01.627 DEBUG:teuthology.orchestra.run.trial119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:08:01.655 INFO:teuthology.orchestra.run.trial119.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T12:08:01.655 INFO:teuthology.orchestra.run.trial119.stdout:============================================================================== 2026-02-17T12:08:01.655 INFO:teuthology.orchestra.run.trial119.stdout:*ntp6.kernfusion 237.17.204.95 2 u 47 64 17 3.631 -0.473 2.006 2026-02-17T12:08:01.655 INFO:teuthology.orchestra.run.trial119.stdout:+time-usw2.crimp 84.168.88.243 2 u 48 64 17 70.866 +0.545 1.962 2026-02-17T12:08:01.655 INFO:teuthology.orchestra.run.trial119.stdout: 144.202.41.38 ( 108.181.220.94 5 u 47 64 17 35.401 -0.598 2.301 2026-02-17T12:08:01.655 INFO:teuthology.orchestra.run.trial119.stdout:+23.186.168.133 132.163.97.4 2 u 53 64 17 75.572 -3.261 1.473 2026-02-17T12:08:01.669 INFO:teuthology.orchestra.run.trial077.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T12:08:01.669 INFO:teuthology.orchestra.run.trial077.stdout:============================================================================== 2026-02-17T12:08:01.669 INFO:teuthology.orchestra.run.trial077.stdout:+172-104-28-175. 80.192.165.246 2 u 53 64 17 3.373 +5.875 4.035 2026-02-17T12:08:01.669 INFO:teuthology.orchestra.run.trial077.stdout:*time-usw2.crimp 84.168.88.243 2 u 50 64 17 70.786 +0.970 5.121 2026-02-17T12:08:01.669 INFO:teuthology.orchestra.run.trial077.stdout:+144.202.41.38 ( 108.181.220.94 5 u 53 64 17 34.784 -1.423 3.909 2026-02-17T12:08:01.669 INFO:teuthology.orchestra.run.trial077.stdout:-23.186.168.133 132.163.97.4 2 u 54 64 17 88.557 -9.415 5.677 2026-02-17T12:08:01.670 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T12:08:01.681 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T12:08:01.681 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T12:08:01.692 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T12:08:01.704 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T12:08:01.717 INFO:teuthology.task.internal:Duration was 398.546011 seconds 2026-02-17T12:08:01.718 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T12:08:01.731 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T12:08:01.731 DEBUG:teuthology.orchestra.run.trial077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T12:08:01.733 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T12:08:01.758 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T12:08:01.758 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial077.front.sepia.ceph.com 2026-02-17T12:08:01.759 DEBUG:teuthology.orchestra.run.trial077:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T12:08:01.804 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial119.front.sepia.ceph.com 2026-02-17T12:08:01.804 DEBUG:teuthology.orchestra.run.trial119:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T12:08:01.810 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T12:08:01.810 DEBUG:teuthology.orchestra.run.trial077:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:08:01.847 DEBUG:teuthology.orchestra.run.trial119:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:08:02.004 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T12:08:02.004 DEBUG:teuthology.orchestra.run.trial077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:08:02.006 DEBUG:teuthology.orchestra.run.trial119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:08:02.013 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:08:02.014 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:08:02.014 INFO:teuthology.orchestra.run.trial077.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T12:08:02.014 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:08:02.014 INFO:teuthology.orchestra.run.trial077.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T12:08:02.015 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:08:02.015 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:08:02.015 INFO:teuthology.orchestra.run.trial119.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T12:08:02.015 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:08:02.016 INFO:teuthology.orchestra.run.trial119.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T12:08:02.059 INFO:teuthology.orchestra.run.trial077.stderr: 81.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T12:08:02.063 INFO:teuthology.orchestra.run.trial119.stderr: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T12:08:02.063 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T12:08:02.080 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T12:08:02.081 DEBUG:teuthology.orchestra.run.trial077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T12:08:02.110 DEBUG:teuthology.orchestra.run.trial119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T12:08:02.119 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T12:08:02.138 DEBUG:teuthology.orchestra.run.trial077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:08:02.156 DEBUG:teuthology.orchestra.run.trial119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:08:02.162 INFO:teuthology.orchestra.run.trial077.stdout:kernel.core_pattern = core 2026-02-17T12:08:02.167 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern = core 2026-02-17T12:08:02.177 DEBUG:teuthology.orchestra.run.trial077:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:08:02.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:08:02.217 DEBUG:teuthology.orchestra.run.trial119:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:08:02.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:08:02.223 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T12:08:02.240 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T12:08:02.241 DEBUG:teuthology.misc:Transferring archived files from trial077:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51399/remote/trial077 2026-02-17T12:08:02.241 DEBUG:teuthology.orchestra.run.trial077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T12:08:02.276 DEBUG:teuthology.misc:Transferring archived files from trial119:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51399/remote/trial119 2026-02-17T12:08:02.276 DEBUG:teuthology.orchestra.run.trial119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T12:08:02.291 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T12:08:02.292 DEBUG:teuthology.orchestra.run.trial077:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T12:08:02.311 DEBUG:teuthology.orchestra.run.trial119:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T12:08:02.330 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T12:08:02.342 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T12:08:02.342 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T12:08:02.356 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T12:08:02.356 DEBUG:teuthology.orchestra.run.trial077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T12:08:02.357 DEBUG:teuthology.orchestra.run.trial119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T12:08:02.359 INFO:teuthology.orchestra.run.trial077.stdout: 1180220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 12:08 /home/ubuntu/cephtest 2026-02-17T12:08:02.375 INFO:teuthology.orchestra.run.trial119.stdout: 1180220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 12:08 /home/ubuntu/cephtest 2026-02-17T12:08:02.376 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T12:08:02.392 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T12:08:02.427 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} duration: 398.5460114479065 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T12:08:02.427 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T12:08:02.533 INFO:teuthology.run:pass